########################################
Timestamp: 2017-03-02T10:06:28GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
[]
Summarize top 5 important features:
important_features2 is empty
Important features list is empty.
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 1.000
Chunk:
Evaluation time span: 2013-02-10 00:00:00 2013-02-16 00:00:00
Model return rate: nan
Original return rate: nan
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-02-16 00:00:00
Model return rate: nan
Original return rate: nan
########################################
Timestamp: 2017-03-02T10:06:31GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
[]
Summarize top 5 important features:
important_features2 is empty
Important features list is empty.
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 1.000
Chunk:
Evaluation time span: 2013-02-17 00:00:00 2013-02-23 00:00:00
Model return rate: nan
Original return rate: nan
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-02-23 00:00:00
Model return rate: nan
Original return rate: nan
########################################
Timestamp: 2017-03-02T10:06:35GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
[]
Summarize top 5 important features:
important_features2 is empty
Important features list is empty.
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 1.000
Chunk:
Evaluation time span: 2013-02-24 00:00:00 2013-03-02 00:00:00
Model return rate: nan
Original return rate: nan
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-03-02 00:00:00
Model return rate: nan
Original return rate: nan
########################################
Timestamp: 2017-03-02T10:06:38GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
[]
Summarize top 5 important features:
important_features2 is empty
Important features list is empty.
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 1.000
Chunk:
Evaluation time span: 2013-03-03 00:00:00 2013-03-09 00:00:00
Model return rate: nan
Original return rate: nan
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-03-09 00:00:00
Model return rate: nan
Original return rate: nan
########################################
Timestamp: 2017-03-02T10:06:42GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
[]
Summarize top 5 important features:
important_features2 is empty
Important features list is empty.
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 1.000
Chunk:
Evaluation time span: 2013-03-10 00:00:00 2013-03-16 00:00:00
Model return rate: nan
Original return rate: nan
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-03-16 00:00:00
Model return rate: nan
Original return rate: nan
########################################
Timestamp: 2017-03-02T10:06:45GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
[]
Summarize top 5 important features:
important_features2 is empty
Important features list is empty.
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = -0.001
Chunk:
Evaluation time span: 2013-03-17 00:00:00 2013-03-23 00:00:00
Model return rate: 0.0
Original return rate: 0.0
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-03-23 00:00:00
Model return rate: 0.0
Original return rate: 0.0
########################################
Timestamp: 2017-03-02T10:06:49GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'pca_comp_48', 'pca_comp_43']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 6305.000000 6305.000000
mean 0.000952 0.000952
std 0.030836 0.030836
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
pca_comp_48 pca_comp_43
count 6.305000e+03 6.305000e+03
mean 1.800997e-18 3.673597e-18
std 3.204550e-02 9.135607e-02
min -5.603634e-01 -2.859878e-01
25% -1.794282e-03 -1.824042e-02
50% 1.207841e-03 -5.065691e-03
75% 4.113957e-03 7.370712e-03
max 7.194844e-01 2.257620e+00
Progress: 20% 40% 60% 80% 100%
Model score = 1.000
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.874
Chunk:
Evaluation time span: 2013-03-25 00:00:00 2013-03-30 00:00:00
Model return rate: 0.0
Original return rate: 0.0
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-03-30 00:00:00
Model return rate: 0.0
Original return rate: 0.0
########################################
Timestamp: 2017-03-02T10:06:54GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'pca_comp_42', 'pca_comp_48', 'pca_comp_37', 'VIN_numDSEligible1', 'pca_comp_54', 'VIN_numTransactions', 'pca_comp_51', 'pca_comp_41', 'SellerID_fracReturnedNotNullDivDSEligible1', 'SellerID_numDSEligible1', 'SellerID_numReturnedNotNull', 'SellingLocation_numReturnedasm1', 'pca_comp_29', 'pca_comp_03', 'pca_comp_11', 'pca_comp_53', 'pca_comp_30', 'pca_comp_35', 'pca_comp_36', 'pca_comp_38', 'pca_comp_49', 'BuyerID_numReturnedNotNull']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5667.000000 5667.000000
mean 0.001147 0.001235
std 0.033193 0.035127
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
pca_comp_42 pca_comp_48 pca_comp_37
count 5.667000e+03 5.667000e+03 5.667000e+03
mean 1.088771e-17 -8.494543e-20 -8.878405e-18
std 1.068222e-01 3.595365e-02 1.933022e-01
min -2.719575e-01 -6.844153e-01 -7.311452e-01
25% -3.173419e-02 -1.569564e-03 -5.942529e-02
50% -8.505077e-03 1.746450e-03 -9.108867e-03
75% 1.450669e-02 4.591372e-03 4.494162e-02
max 3.082570e+00 9.875722e-01 2.116968e+00
Progress: 20% 40% 60% 80% 100%
Model score = 0.933
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.915
Chunk:
Evaluation time span: 2013-03-31 00:00:00 2013-04-06 00:00:00
Model return rate: 0.0263157894737
Original return rate: 0.0263157894737
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-04-06 00:00:00
Model return rate: 0.02
Original return rate: 0.02
########################################
Timestamp: 2017-03-02T10:06:59GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_60', 'BuyerID_numReturned1', 'pca_comp_56', 'SellerID_fracReturned1DivReturnedNotNull', 'SellerID_numReturned1', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_62', 'pca_comp_52', 'VIN_numReturned1', 'VIN_numReturnedasm1', 'pca_comp_29', 'pca_comp_53', 'pca_comp_61', 'CarMake_fracReturned1DivReturnedNotNull', 'JDPowersCat_fracReturned1DivReturnedNotNull', 'pca_comp_57', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_44']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 5606.000000 5606.000000
mean 0.006778 0.006422
std 0.082059 0.078760
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
Returned_asm BuyerID_fracReturned1DivReturnedNotNull pca_comp_60
count 5606.000000 5606.000000 5.606000e+03
mean 0.052265 0.000178 4.017610e-17
std 0.222582 0.009443 1.193985e-02
min 0.000000 0.000000 -5.619663e-01
25% 0.000000 0.000000 -1.621865e-03
50% 0.000000 0.000000 6.944911e-06
75% 0.000000 0.000000 1.739356e-03
max 1.000000 0.500000 2.592061e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.975
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 1.000
Chunk:
Evaluation time span: 2013-04-07 00:00:00 2013-04-13 00:00:00
Model return rate: 0.0
Original return rate: 0.0
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-04-13 00:00:00
Model return rate: 0.0103092783505
Original return rate: 0.0103092783505
########################################
Timestamp: 2017-03-02T10:07:05GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1
count 6090.000000 6090.000000
mean 0.007718 0.007635
std 0.087517 0.086818
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.998
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.928
Chunk:
Evaluation time span: 2013-04-14 00:00:00 2013-04-19 00:00:00
Model return rate: 0.0535714285714
Original return rate: 0.0535714285714
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-04-19 00:00:00
Model return rate: 0.0261437908497
Original return rate: 0.0261437908497
########################################
Timestamp: 2017-03-02T10:07:10GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturnedasm1', 'VIN_fracReturnedasm1DivTransactions', 'SellerID_numReturned1', 'Returned_asm', 'VIN_numReturned1', 'VIN_numDSEligible1', 'pca_comp_40', 'VIN_numTransactions', 'pca_comp_42', 'pca_comp_57', 'pca_comp_62', 'LIGHTG', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_45', 'pca_comp_46', 'pca_comp_56', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_13', 'pca_comp_38', 'pca_comp_58', 'pca_comp_35', 'pca_comp_26', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_16', 'SalePrice', 'CarMake_fracReturned1DivReturnedNotNull', 'JDPowersCat_fracDSEligible1DivTransactions', 'JDPowersCat_MIDSIZECAR', 'pca_comp_61', 'SellerID_numDSEligible1', 'SellerID_numTransactions', 'CarMake_fracReturnedasm1DivTransactions', 'CarYear', 'pca_comp_02', 'pca_comp_17', 'pca_comp_68', 'pca_comp_20', 'pca_comp_53', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_63', 'pca_comp_59', 'JDPowersCat_fracReturnedasm1DivTransactions', 'pca_comp_39', 'pca_comp_36', 'pca_comp_19', 'pca_comp_11', 'pca_comp_07', 'pca_comp_43', 'LIGHT_N0G1Y2R3', 'pca_comp_34', 'JDPowersCat_numReturnedasm1', 'CarMake_numDSEligible1', 'pca_comp_70', 'SellingLocation_fracReturnedasm1DivTransactions', 'pca_comp_44', 'pca_comp_51', 'pca_comp_08', 'BuyerID_fracDSEligible1DivTransactions']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5720.000000 5720.000000
mean 0.009965 0.010315
std 0.098451 0.101045
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturnedasm1 \
count 5720.000000 5720.000000
mean 0.000524 0.052797
std 0.022897 0.225981
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturnedasm1DivTransactions
count 5720.000000
mean 0.051573
std 0.220392
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.968
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.932
Chunk:
Evaluation time span: 2013-04-21 00:00:00 2013-04-27 00:00:00
Model return rate: 0.0
Original return rate: 0.0576923076923
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-04-27 00:00:00
Model return rate: 0.02
Original return rate: 0.0341463414634
########################################
Timestamp: 2017-03-02T10:07:16GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'pca_comp_44', 'pca_comp_27', 'pca_comp_06', 'pca_comp_37', 'pca_comp_63', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'VIN_numDSEligible1', 'pca_comp_60', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_19', 'pca_comp_66', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_12', 'BuyerID_numReturnedNotNull', 'pca_comp_17', 'pca_comp_04', 'pca_comp_01', 'pca_comp_05', 'pca_comp_65', 'SalePrice', 'pca_comp_02', 'pca_comp_16', 'pca_comp_22', 'pca_comp_35', 'VIN_numTransactions', 'pca_comp_24', 'ConditionReport', 'pca_comp_00', 'pca_comp_36', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_34', 'JDPowersCat_fracReturned1DivReturnedNotNull', 'pca_comp_49', 'pca_cluster_1_dist', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_47', 'pca_comp_31', 'pca_comp_30', 'pca_comp_64', 'SellingLocation_numReturnedasm1', 'MMR', 'CarMake_fracReturnedasm1DivTransactions', 'pca_comp_28', 'JDPowersCat_numReturned1', 'CarMake_numDSEligible1', 'CarMake_numTransactions', 'pca_comp_11', 'CarMake_fracReturnedNotNullDivDSEligible1', 'Autocheck_score', 'JDPowersCat_fracDSEligible1DivTransactions', 'SellingLocation_numReturnedNotNull', 'pca_cluster_0_dist', 'pca_comp_68', 'pca_comp_20', 'pca_comp_71', 'pca_comp_38']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 6074.000000 6074.000000
mean 0.008232 0.007601
std 0.090363 0.085236
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
pca_comp_44 pca_comp_27 pca_comp_06
count 6.074000e+03 6.074000e+03 6.074000e+03
mean -7.522428e-17 2.805488e-17 -2.402681e-17
std 1.067775e-01 4.031969e-01 2.309402e+00
min -8.689928e-01 -2.956313e+00 -1.694126e+01
25% -2.626192e-02 -1.180146e-01 -3.569849e-01
50% 2.941517e-04 -4.050110e-03 7.012193e-01
75% 2.743399e-02 1.578955e-01 1.166400e+00
max 1.281656e+00 1.778804e+00 1.337341e+01
Progress: 20% 40% 60% 80% 100%
Model score = 0.979
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.862
Chunk:
Evaluation time span: 2013-04-28 00:00:00 2013-05-04 00:00:00
Model return rate: 0.0816326530612
Original return rate: 0.0816326530612
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-05-04 00:00:00
Model return rate: 0.0321285140562
Original return rate: 0.0433070866142
########################################
Timestamp: 2017-03-02T10:07:22GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_fracReturnedasm1DivTransactions', 'VIN_numReturnedasm1', 'Returned_asm', 'VIN_numReturned1', 'VIN_numTransactions', 'JDPowersCat_COMPACTCAR', 'pca_comp_64', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'VIN_numDSEligible1', 'pca_comp_38', 'pca_comp_62', 'pca_comp_57', 'pca_comp_41', 'pca_comp_65', 'pca_comp_60', 'pca_comp_46', 'pca_comp_55', 'pca_comp_26', 'pca_comp_09', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_61', 'pca_comp_45', 'LIGHTG', 'pca_comp_39', 'pca_comp_28', 'pca_comp_10', 'pca_comp_25', 'pca_comp_50', 'SellerID_numReturnedNotNull', 'pca_comp_13', 'pca_comp_21', 'SellerID_numDSEligible1', 'pca_comp_48', 'pca_comp_40', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_17', 'pca_comp_53', 'Autocheck_score', 'SellingLocation_numTransactions', 'pca_comp_11', 'pca_comp_49', 'CarYear', 'pca_comp_52', 'pca_comp_58']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5565.000000 5565.000000
mean 0.009224 0.010063
std 0.093496 0.099817
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_fracReturned1DivReturnedNotNull \
count 5565.000000
mean 0.000719
std 0.026803
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
VIN_fracReturnedasm1DivTransactions VIN_numReturnedasm1
count 5565.000000 5565.000000
mean 0.045103 0.045642
std 0.206899 0.208727
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.988
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.944
Chunk:
Evaluation time span: 2013-05-05 00:00:00 2013-05-11 00:00:00
Model return rate: 0.0462962962963
Original return rate: 0.274647887324
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-05-11 00:00:00
Model return rate: 0.0364145658263
Original return rate: 0.126262626263
########################################
Timestamp: 2017-03-02T10:07:29GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'PSIEligible', 'Returned_asm', 'VIN_numReturnedasm1', 'VIN_fracReturnedasm1DivTransactions', 'VIN_numTransactions', 'pca_comp_62', 'cluster_1_dist', 'pca_cluster_0_dist', 'pca_comp_37', 'VIN_numDSEligible1', 'pca_comp_60', 'pca_comp_58', 'pca_comp_53', 'pca_comp_61', 'pca_comp_30', 'pca_comp_32', 'pca_comp_26', 'pca_comp_36', 'MMR', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_49', 'pca_comp_13', 'pca_comp_68', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_40', 'pca_comp_54', 'pca_comp_11', 'SalePrice', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_22', 'BuyerID_numReturnedNotNull', 'pca_comp_04', 'pca_comp_56', 'BuyerID_numReturned1', 'BuyerID_numDSEligible1', 'LIGHT_N0G1Y2R3', 'pca_comp_66', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_59', 'pca_comp_48', 'pca_comp_12', 'pca_cluster_1_dist']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6193.000000 6193.000000
mean 0.017116 0.018892
std 0.126599 0.137337
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturned1 PSIEligible
count 6193.000000 6193.000000 6193.000000
mean 0.000807 0.000807 0.717261
std 0.028405 0.028405 0.450367
min 0.000000 0.000000 0.000000
25% 0.000000 0.000000 0.000000
50% 0.000000 0.000000 1.000000
75% 0.000000 0.000000 1.000000
max 1.000000 1.000000 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.993
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.988
Chunk:
Evaluation time span: 2013-05-12 00:00:00 2013-05-18 00:00:00
Model return rate: 0.0
Original return rate: 0.269662921348
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-05-18 00:00:00
Model return rate: 0.0308056872038
Original return rate: 0.152577319588
########################################
Timestamp: 2017-03-02T10:07:35GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'pca_comp_39', 'pca_comp_59', 'VIN_numDSEligible1', 'VIN_numTransactions', 'SellingLocation_lat', 'SellingLocation_lon', 'SaleDate_decyear', 'SellingLocation_numReturned1', 'pca_comp_35', 'SellingLocation_numReturnedNotNull', 'pca_comp_34', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'SaleDate_dow', 'SellingLocation_numReturnedasm1', 'SellingLocation_numTransactions', 'SellingLocation_fracDSEligible1DivTransactions', 'SaleDate_doy', 'LIGHTR', 'SellerID_numReturned1', 'pca_comp_26', 'LIGHT_N0G1Y2R3', 'pca_comp_41', 'cluster_0_dist', 'SellingLocation_fracReturnedasm1DivTransactions', 'MMR', 'PSIEligible', 'CarYear', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_14', 'pca_comp_62', 'pca_comp_03', 'pca_comp_11', 'BuyerID_numReturnedNotNull', 'Autocheck_score', 'pca_comp_60', 'Mileage', 'SaleDate_day', 'SalePrice', 'pca_comp_19', 'BuyerID_fracDSEligible1DivTransactions', 'SellingLocation_numDSEligible1', 'pca_comp_15']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5892.000000 5892.000000
mean 0.011301 0.012220
std 0.103758 0.109876
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
pca_comp_39 pca_comp_59 VIN_numDSEligible1
count 5.892000e+03 5.892000e+03 5892.000000
mean -7.553054e-18 3.145844e-17 0.969280
std 1.405811e-01 1.393887e-02 0.292334
min -7.222085e-01 -3.834046e-01 0.000000
25% -3.100796e-02 -1.797219e-03 1.000000
50% -7.999452e-03 -5.371319e-04 1.000000
75% 1.288353e-02 8.922595e-04 1.000000
max 1.658963e+00 9.674088e-02 4.000000
Progress: 20% 40% 60% 80% 100%
Model score = 1.000
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.850
Chunk:
Evaluation time span: 2013-05-19 00:00:00 2013-05-25 00:00:00
Model return rate: 0.185567010309
Original return rate: 0.185567010309
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-05-25 00:00:00
Model return rate: 0.0795454545455
Original return rate: 0.162002945508
########################################
Timestamp: 2017-03-02T10:07:41GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'pca_comp_62', 'VIN_numDSEligible1', 'pca_comp_63', 'pca_comp_35', 'VIN_numTransactions', 'pca_comp_66', 'SellerID_numReturned1', 'SellerID_fracReturned1DivReturnedNotNull', 'SellerID_numReturnedNotNull', 'SellingLocation_fracDSEligible1DivTransactions', 'SellingLocation_numReturnedNotNull', 'pca_comp_07', 'SellingLocation_fracReturnedasm1DivTransactions', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'SellingLocation_numReturned1', 'pca_comp_14', 'pca_comp_18', 'pca_comp_12', 'pca_comp_31', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_01', 'pca_comp_55', 'pca_comp_40', 'cluster_0_dist', 'SellerID_fracReturnedNotNullDivDSEligible1', 'SellerID_fracDSEligible1DivTransactions', 'SaleDate_doy', 'JDPowersCat_numReturned1']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 5830.000000 5830.000000
mean 0.034991 0.033419
std 0.183774 0.177597
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
Returned_asm pca_comp_62 VIN_numDSEligible1
count 5830.000000 5.830000e+03 5830.000000
mean 0.054717 7.200739e-20 0.981990
std 0.227446 2.133689e-02 0.282475
min 0.000000 -4.286332e-01 0.000000
25% 0.000000 -1.693213e-03 1.000000
50% 0.000000 -6.199982e-04 1.000000
75% 0.000000 5.975842e-04 1.000000
max 1.000000 2.311126e-01 3.000000
Progress: 20% 40% 60% 80% 100%
Model score = 1.000
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.991
Chunk:
Evaluation time span: 2013-05-26 00:00:00 2013-05-31 00:00:00
Model return rate: 0.0
Original return rate: 0.298780487805
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-05-31 00:00:00
Model return rate: 0.0670314637483
Original return rate: 0.188612099644
########################################
Timestamp: 2017-03-02T10:07:48GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'pca_comp_58', 'VIN_numTransactions', 'pca_comp_57', 'pca_comp_35', 'VIN_numDSEligible1', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_37', 'pca_comp_52', 'pca_comp_47', 'pca_comp_53', 'pca_comp_38', 'pca_comp_48', 'pca_comp_49', 'BuyerID_numTransactions', 'BuyerID_numDSEligible1', 'pca_comp_17', 'pca_comp_01', 'pca_comp_04', 'pca_comp_16', 'pca_comp_54', 'pca_comp_65', 'pca_comp_55', 'pca_comp_03', 'pca_comp_09', 'VIN_numReturned1', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_08', 'pca_comp_50', 'pca_comp_61', 'pca_comp_68', 'CarMake_fracReturnedasm1DivTransactions', 'CarMake_fracDSEligible1DivTransactions']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 4901.000000 4901.000000
mean 0.024281 0.023295
std 0.153935 0.149361
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
pca_comp_58 VIN_numTransactions pca_comp_57
count 4.901000e+03 4901.000000 4.901000e+03
mean -2.741295e-17 1.032034 -3.025910e-16
std 2.345620e-02 0.181811 2.492683e-02
min -5.172341e-01 1.000000 -2.294217e-01
25% -2.889731e-03 1.000000 -4.332962e-03
50% -7.620604e-04 1.000000 -7.799630e-04
75% 1.693913e-03 1.000000 2.870260e-03
max 1.769475e-01 3.000000 4.441703e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.981
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.743
Chunk:
Evaluation time span: 2013-06-02 00:00:00 2013-06-08 00:00:00
Model return rate: 0.30243902439
Original return rate: 0.30243902439
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-06-08 00:00:00
Model return rate: 0.11858974359
Original return rate: 0.210877862595
########################################
Timestamp: 2017-03-02T10:07:54GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_39', 'VIN_numDSEligible1', 'VIN_numTransactions', 'pca_comp_61', 'pca_comp_64', 'Mileage', 'pca_comp_60', 'BuyerID_numReturnedNotNull', 'SellingLocation_fracReturned1DivReturnedNotNull', 'pca_comp_16', 'pca_comp_67', 'CarMake_numReturned1', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_32', 'pca_comp_07', 'pca_comp_41', 'BuyerID_numDSEligible1', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_55', 'BuyerID_numTransactions', 'pca_comp_26', 'pca_comp_49', 'pca_comp_08', 'pca_comp_34', 'pca_comp_35', 'pca_comp_63', 'pca_comp_04', 'Arbitrated', 'pca_comp_30', 'Autocheck_score', 'pca_comp_70', 'pca_comp_13', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'SellingLocation_numReturnedNotNull', 'pca_comp_18', 'PSIEligible', 'pca_comp_21', 'pca_comp_23', 'pca_comp_20', 'JDPowersCat_fracDSEligible1DivTransactions', 'CarYear', 'CarMake_numReturnedasm1', 'CarMake_numReturnedNotNull', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_14', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_02', 'SellerID_fracReturnedNotNullDivDSEligible1', 'CarMake_fracReturnedNotNullDivDSEligible1', 'SellingLocation_numDSEligible1', 'pca_comp_51', 'pca_comp_58', 'pca_comp_47', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_00', 'BuyerID_numReturnedasm1', 'pca_comp_43', 'pca_comp_59', 'SaleDate_dow', 'LIGHTR', 'pca_comp_33', 'SellerID_numDSEligible1', 'SellerID_fracReturnedasm1DivTransactions', 'SellingLocation_lat', 'SellingLocation_numReturned1', 'pca_comp_36', 'PSI', 'SaleDate_doy', 'pca_comp_48', 'SellingLocation_fracReturnedasm1DivTransactions', 'pca_cluster_0_dist', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_09', 'pca_comp_25', 'CarMake_numTransactions']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 6361.000000 6361.000000
mean 0.033485 0.032005
std 0.179914 0.174046
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
Returned_asm BuyerID_fracReturnedNotNullDivDSEligible1 pca_comp_39
count 6361.000000 6361.000000 6.361000e+03
mean 0.065556 0.008813 -2.967111e-18
std 0.247523 0.040236 2.261858e-01
min 0.000000 0.000000 -1.114342e+00
25% 0.000000 0.000000 -7.745039e-02
50% 0.000000 0.000000 -1.436190e-02
75% 0.000000 0.000000 4.729452e-02
max 1.000000 1.000000 3.368160e+00
Progress: 20% 40% 60% 80% 100%
Model score = 0.997
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.982
Chunk:
Evaluation time span: 2013-06-10 00:00:00 2013-06-15 00:00:00
Model return rate: 0.0
Original return rate: 0.278195488722
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-06-15 00:00:00
Model return rate: 0.0984042553191
Original return rate: 0.224505327245
########################################
Timestamp: 2017-03-02T10:08:01GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numDSEligible1', 'BuyerID_numReturnedNotNull', 'pca_comp_35', 'pca_comp_37', 'pca_comp_05', 'pca_comp_36', 'VIN_fracReturned1DivReturnedNotNull', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_59', 'pca_comp_56', 'pca_comp_60', 'pca_comp_11', 'VIN_numReturned1', 'pca_comp_22', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_03', 'pca_comp_10', 'Autocheck_score', 'CarMake_fracDSEligible1DivTransactions', 'cluster_0_dist', 'pca_comp_15', 'VIN_numReturnedasm1', 'pca_comp_58', 'CarMake_fracReturnedasm1DivTransactions', 'pca_cluster_0_dist', 'pca_comp_41', 'pca_comp_31', 'pca_comp_54', 'Mileage', 'pca_comp_32', 'pca_comp_23', 'SellerID_numReturnedasm1', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_52', 'pca_comp_19', 'SellerID_fracReturned1DivReturnedNotNull', 'JDPowersCat_numReturnedNotNull', 'CarMake_numReturned1', 'pca_comp_65', 'pca_comp_33', 'CarMake_numReturnedNotNull', 'pca_comp_14', 'SellerID_numDSEligible1', 'pca_comp_27', 'pca_comp_43', 'SellerID_numTransactions', 'pca_comp_29', 'pca_comp_40', 'pca_comp_48', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_30', 'pca_comp_04', 'pca_comp_17', 'pca_comp_61', 'SellerID_fracReturnedasm1DivTransactions']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 6134.000000 6134.000000
mean 0.033094 0.030758
std 0.178897 0.169364
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_numDSEligible1 BuyerID_numReturnedNotNull pca_comp_35
count 6134.000000 6134.000000 6.134000e+03
mean 0.956798 0.988099 -2.352934e-19
std 0.308463 3.925321 2.369513e-01
min 0.000000 0.000000 -1.014847e+00
25% 1.000000 0.000000 -1.442965e-01
50% 1.000000 0.000000 -3.722976e-02
75% 1.000000 0.000000 1.401617e-01
max 3.000000 60.000000 1.651857e+00
Progress: 20% 40% 60% 80% 100%
Model score = 0.965
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.813
Chunk:
Evaluation time span: 2013-06-16 00:00:00 2013-06-22 00:00:00
Model return rate: 0.166153846154
Original return rate: 0.166153846154
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-06-22 00:00:00
Model return rate: 0.11355815554
Original return rate: 0.21293471629
########################################
Timestamp: 2017-03-02T10:08:07GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'pca_comp_66', 'VIN_fracReturnedasm1DivTransactions', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_62', 'pca_comp_64', 'pca_comp_46', 'pca_comp_10', 'pca_comp_68', 'pca_comp_50', 'pca_comp_36', 'pca_comp_65', 'pca_comp_42', 'Arbitrated', 'pca_cluster_0_dist', 'JDPowersCat_COMPACTCAR', 'BuyerID_numReturnedNotNull', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_00', 'pca_comp_61', 'SellerID_numReturnedasm1', 'cluster_1_dist', 'pca_comp_57', 'pca_cluster_1_dist', 'CarYear', 'pca_comp_11', 'pca_comp_59', 'cluster_0_dist', 'pca_comp_58', 'BuyerID_fracReturnedasm1DivTransactions', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_21', 'pca_comp_48', 'pca_comp_39', 'pca_comp_54', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_37', 'pca_comp_06', 'SellerID_numDSEligible1', 'SellingLocation_numReturned1', 'pca_comp_08', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'pca_comp_24', 'DSEligible', 'pca_comp_22', 'pca_comp_40', 'CarMake_fracReturnedasm1DivTransactions', 'pca_comp_18', 'VIN_numReturned1', 'pca_comp_16', 'JDPowersCat_VAN', 'pca_comp_69', 'pca_comp_34', 'pca_comp_05', 'pca_comp_12', 'pca_comp_29', 'SellerID_numTransactions', 'JDPowersCat_numTransactions', 'JDPowersCat_fracReturnedasm1DivTransactions', 'JDPowersCat_SUV', 'pca_comp_56', 'pca_comp_47', 'BuyerID_numDSEligible1', 'SellingLocation_numDSEligible1', 'pca_comp_35', 'Mileage', 'pca_comp_03', 'pca_comp_72', 'pca_comp_27', 'pca_comp_20']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6020.000000 6020.000000
mean 0.054070 0.056146
std 0.224052 0.230943
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm pca_comp_66 VIN_fracReturnedasm1DivTransactions
count 6020.000000 6.020000e+03 6020.000000
mean 0.067774 1.362857e-17 0.068660
std 0.251379 7.584248e-03 0.251009
min 0.000000 -2.202392e-01 0.000000
25% 0.000000 -8.749921e-04 0.000000
50% 0.000000 -2.065304e-04 0.000000
75% 0.000000 5.339752e-04 0.000000
max 1.000000 1.736245e-01 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.988
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.983
Chunk:
Evaluation time span: 2013-06-23 00:00:00 2013-06-29 00:00:00
Model return rate: 0.0
Original return rate: 0.203187250996
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-06-29 00:00:00
Model return rate: 0.0890447922288
Original return rate: 0.210649229332
########################################
Timestamp: 2017-03-02T10:08:14GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturned1', 'pca_comp_56', 'VIN_fracReturned1DivReturnedNotNull', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_36', 'pca_comp_61', 'VIN_numDSEligible1', 'BuyerID_numReturnedNotNull', 'pca_comp_44', 'cluster_1_dist', 'pca_comp_00', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_54', 'pca_comp_13', 'SellingLocation_fracReturned1DivReturnedNotNull', 'JDPowersCat_SPORTSCAR', 'pca_comp_07', 'pca_comp_60', 'pca_comp_32', 'BuyerID_numTransactions', 'BuyerID_numDSEligible1', 'pca_comp_43', 'pca_comp_11', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_21', 'SellerID_numReturned1', 'SellingLocation_fracReturnedasm1DivTransactions', 'SellingLocation_lat', 'pca_comp_67', 'VIN_numTransactions', 'pca_cluster_1_dist', 'pca_comp_52', 'pca_comp_47', 'pca_comp_48', 'pca_comp_01', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_50', 'BuyerID_numReturned1', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_49', 'JDPowersCat_numReturnedasm1', 'JDPowersCat_numReturnedNotNull', 'pca_comp_05', 'pca_comp_40', 'pca_comp_41', 'pca_comp_38', 'pca_comp_08', 'pca_comp_15', 'pca_comp_02', 'pca_comp_68', 'pca_comp_14', 'pca_comp_27', 'JDPowersCat_SUV', 'pca_comp_51', 'JDPowersCat_numReturned1', 'SellerID_numTransactions', 'pca_comp_20', 'JDPowersCat_fracDSEligible1DivTransactions', 'pca_comp_62', 'pca_comp_65', 'DSEligible', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_37', 'CarMake_numReturnedasm1', 'pca_cluster_0_dist', 'pca_comp_66', 'SellingLocation_numTransactions', 'BuyerID_fracReturnedasm1DivTransactions', 'JDPowersCat_numTransactions', 'pca_comp_69', 'CarYear', 'JDPowersCat_numDSEligible1', 'pca_comp_35', 'pca_comp_26', 'cluster_0_dist', 'SellerID_fracReturnedasm1DivTransactions', 'SellerID_numDSEligible1', 'pca_comp_55', 'LIGHT_N0G1Y2R3', 'pca_cluster', 'CarMake_fracReturned1DivReturnedNotNull', 'Returned_asm', 'MMR', 'CarMake_fracReturnedasm1DivTransactions', 'SellingLocation_numReturnedasm1', 'pca_comp_45', 'pca_comp_10', 'pca_comp_46', 'Autocheck_score', 'BuyerID_numReturnedasm1', 'JDPowersCat_fracReturnedasm1DivTransactions', 'pca_comp_59', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedasm1', 'pca_comp_33', 'pca_comp_22', 'pca_comp_31', 'LIGHTR', 'pca_comp_23', 'pca_comp_12', 'CarMake_numReturned1', 'JDPowersCat_PICKUP', 'pca_comp_25', 'SaleDate_decyear', 'Mileage', 'pca_comp_53']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 5937.000000 5937.000000
mean 0.069564 0.067065
std 0.254432 0.247722
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_numReturned1 pca_comp_56 VIN_fracReturned1DivReturnedNotNull
count 5937.000000 5.937000e+03 5937.000000
mean 0.000842 -1.329633e-17 0.000842
std 0.029010 4.357245e-02 0.029010
min 0.000000 -2.964535e-01 0.000000
25% 0.000000 -6.923517e-03 0.000000
50% 0.000000 -5.427751e-04 0.000000
75% 0.000000 7.572756e-03 0.000000
max 1.000000 1.344847e+00 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.990
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.479
Chunk:
Evaluation time span: 2013-06-30 00:00:00 2013-07-06 00:00:00
Model return rate: 0.220708446866
Original return rate: 0.220708446866
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-07-06 00:00:00
Model return rate: 0.110810810811
Original return rate: 0.212121212121
########################################
Timestamp: 2017-03-02T10:08:21GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_67', 'VIN_numDSEligible1', 'DSEligible', 'pca_comp_00', 'BuyerID_numReturned1', 'pca_comp_64', 'VIN_numTransactions', 'pca_comp_42', 'pca_comp_65', 'pca_comp_63', 'BuyerID_numReturnedNotNull', 'cluster_0_dist', 'pca_comp_49', 'pca_comp_45', 'pca_comp_37', 'pca_comp_72', 'cluster', 'pca_comp_58', 'CarYear', 'pca_cluster', 'pca_comp_01', 'pca_comp_39', 'SellerID_numDSEligible1', 'pca_comp_31', 'pca_comp_35', 'pca_comp_34', 'SellerID_numTransactions', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_cluster_1_dist', 'SellerID_fracReturnedasm1DivTransactions', 'pca_comp_36', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_20', 'pca_comp_10', 'cluster_1_dist']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 Returned_asm \
count 3750.000000 3750.000000
mean 0.099956 0.088000
std 0.297239 0.283333
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_numReturnedNotNull VIN_fracReturned1DivReturnedNotNull \
count 3750.000000 3750.000000
mean 0.103733 0.025067
std 0.305828 0.156348
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 2.000000 1.000000
VIN_numReturned1
count 3750.000000
mean 0.025333
std 0.158845
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 2.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.987
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.985
Chunk:
Evaluation time span: 2013-07-07 00:00:00 2013-07-13 00:00:00
Model return rate: 0.0
Original return rate: 0.2
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-07-13 00:00:00
Model return rate: 0.0919282511211
Original return rate: 0.20987654321
########################################
Timestamp: 2017-03-02T10:08:28GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_numReturnedNotNull', 'VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numDSEligible1', 'pca_comp_45', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_44', 'Mileage', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_40', 'SellerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_numReturnedNotNull', 'CarMake_numReturned1', 'pca_comp_38', 'pca_comp_53', 'CarMake_numReturnedNotNull', 'pca_comp_31', 'pca_comp_52', 'cluster_1_dist', 'pca_comp_39', 'CarMake_fracDSEligible1DivTransactions', 'cluster_0_dist', 'pca_comp_56', 'CarMake_fracReturnedasm1DivTransactions', 'pca_comp_22', 'CarMake_numDSEligible1', 'pca_cluster_0_dist', 'JDPowersCat_PICKUP', 'pca_comp_16', 'pca_comp_28', 'pca_cluster_1_dist', 'SellerID_fracReturnedasm1DivTransactions', 'CarMake_numTransactions', 'CarMake_numReturnedasm1', 'pca_comp_34', 'SellerID_fracDSEligible1DivTransactions', 'SellerID_numDSEligible1', 'pca_comp_59', 'pca_comp_19', 'SellerID_numReturnedNotNull', 'pca_comp_14', 'SellerID_numTransactions', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_33']
Summarize top 5 important features:
VIN_numReturnedNotNull VIN_fracReturnedNotNullDivDSEligible1 \
count 6574.000000 6574.000000
mean 0.071342 0.069364
std 0.257414 0.252138
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_numDSEligible1 pca_comp_45 \
count 6574.000000 6.574000e+03
mean 0.968969 9.178571e-17
std 0.294911 1.240888e-01
min 0.000000 -1.320551e+00
25% 1.000000 -4.878065e-02
50% 1.000000 -1.317990e-02
75% 1.000000 1.669662e-02
max 4.000000 2.122892e+00
SellerID_fracReturned1DivReturnedNotNull
count 6574.000000
mean 0.047432
std 0.128853
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.993
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.802
Chunk:
Evaluation time span: 2013-07-14 00:00:00 2013-07-20 00:00:00
Model return rate: 0.244698205546
Original return rate: 0.244698205546
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-07-20 00:00:00
Model return rate: 0.120401337793
Original return rate: 0.215659712815
########################################
Timestamp: 2017-03-02T10:08:36GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'pca_comp_65', 'pca_cluster_1_dist', 'pca_comp_66', 'pca_comp_01', 'VIN_numDSEligible1', 'pca_comp_64', 'pca_cluster_0_dist', 'cluster_0_dist', 'BuyerID_numReturnedNotNull', 'VIN_numTransactions', 'pca_comp_59', 'cluster_1_dist', 'pca_comp_31', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_numReturned1', 'pca_comp_63', 'pca_comp_09', 'Mileage', 'cluster', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_55', 'pca_comp_56', 'pca_comp_52', 'pca_comp_00', 'pca_comp_36', 'SellerID_numDSEligible1', 'Arbitrated', 'pca_comp_12', 'pca_comp_33', 'pca_comp_05', 'pca_comp_08', 'pca_comp_51', 'MMR', 'Autocheck_score', 'pca_comp_42', 'SellerID_numTransactions', 'CarYear', 'pca_comp_37', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_16', 'pca_comp_46', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_47', 'pca_comp_24', 'JDPowersCat_numReturnedNotNull', 'pca_comp_53', 'BuyerID_numReturnedasm1', 'SellerID_numReturnedasm1', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_38', 'pca_comp_07', 'PSI', 'pca_comp_70', 'VIN_fracReturnedasm1DivTransactions', 'SalePrice', 'BuyerID_numTransactions', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_67', 'pca_comp_54', 'pca_comp_04', 'pca_comp_49']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6189.000000 6189.000000
mean 0.098872 0.104217
std 0.295212 0.309769
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull VIN_numReturned1
count 6189.000000 6189.000000 6189.000000
mean 0.064631 0.025852 0.026499
std 0.245893 0.158453 0.163616
min 0.000000 0.000000 0.000000
25% 0.000000 0.000000 0.000000
50% 0.000000 0.000000 0.000000
75% 0.000000 0.000000 0.000000
max 1.000000 1.000000 2.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.996
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.986
Chunk:
Evaluation time span: 2013-07-21 00:00:00 2013-07-27 00:00:00
Model return rate: 0.0
Original return rate: 0.269097222222
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-07-27 00:00:00
Model return rate: 0.106882591093
Original return rate: 0.22287321303
########################################
Timestamp: 2017-03-02T10:08:43GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_numReturnedasm1', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_60', 'pca_comp_52', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_36', 'VIN_numReturned1', 'pca_comp_53', 'Returned_asm', 'pca_comp_37', 'SellingLocation_lon', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'DSEligible', 'pca_comp_01', 'VIN_numTransactions', 'SellerID_fracReturned1DivReturnedNotNull', 'BuyerID_numReturnedNotNull', 'pca_comp_66', 'BuyerID_numDSEligible1', 'pca_comp_50', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_56', 'pca_comp_05', 'SellerID_fracReturnedasm1DivTransactions', 'SellingLocation_fracReturned1DivReturnedNotNull', 'cluster_1_dist', 'pca_comp_34', 'BuyerID_numTransactions', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_00', 'pca_comp_48', 'CarMake_fracReturnedNotNullDivDSEligible1', 'SellingLocation_fracReturnedasm1DivTransactions', 'pca_comp_16', 'pca_comp_11', 'pca_comp_40', 'pca_comp_06', 'CarYear', 'pca_cluster_0_dist', 'pca_comp_29', 'pca_comp_57', 'SellingLocation_lat', 'pca_comp_38', 'cluster_0_dist', 'BuyerID_fracReturned1DivReturnedNotNull', 'SellingLocation_numTransactions', 'JDPowersCat_VAN', 'pca_comp_39', 'pca_comp_07', 'pca_comp_28', 'pca_comp_24', 'pca_comp_58', 'pca_comp_42', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_63', 'pca_comp_09', 'pca_comp_31', 'SellingLocation_numReturnedasm1', 'BuyerID_numReturnedasm1', 'pca_comp_10', 'pca_comp_68', 'LIGHT_N0G1Y2R3', 'pca_comp_33', 'pca_comp_21', 'pca_comp_49', 'pca_comp_23', 'SellingLocation_numReturnedNotNull', 'LIGHTR', 'pca_comp_27', 'pca_comp_03', 'SalePrice', 'Arbitrated', 'pca_comp_45', 'pca_comp_46', 'SellerID_fracDSEligible1DivTransactions', 'JDPowersCat_numReturnedNotNull', 'JDPowersCat_numDSEligible1', 'pca_comp_54', 'pca_comp_15', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_32', 'pca_comp_18', 'VIN_numDSEligible1', 'pca_comp_44', 'pca_comp_59', 'SellerID_numReturnedasm1', 'pca_comp_51', 'Autocheck_score', 'MMR', 'pca_comp_47', 'SellingLocation_numDSEligible1', 'pca_comp_41', 'pca_comp_04', 'Mileage', 'pca_comp_13', 'pca_comp_64', 'pca_comp_25', 'pca_comp_65', 'SellingLocation_numReturned1', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_61', 'pca_comp_55', 'JDPowersCat_numReturned1', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'SellerID_numReturned1', 'pca_comp_69', 'JDPowersCat_COMPACTCAR', 'VIN_fracDSEligible1DivTransactions']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5786.000000 5786.000000
mean 0.072531 0.076218
std 0.256053 0.266021
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_numReturnedasm1 VIN_fracReturnedasm1DivTransactions pca_comp_60
count 5786.000000 5786.000000 5.786000e+03
mean 0.095230 0.087885 -1.499662e-17
std 0.300541 0.278578 2.409827e-02
min 0.000000 0.000000 -5.944825e-01
25% 0.000000 0.000000 -2.675429e-03
50% 0.000000 0.000000 -1.020192e-03
75% 0.000000 0.000000 9.534016e-04
max 2.000000 1.000000 2.659562e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.994
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.362
Chunk:
Evaluation time span: 2013-07-28 00:00:00 2013-08-03 00:00:00
Model return rate: 0.256944444444
Original return rate: 0.256944444444
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-08-03 00:00:00
Model return rate: 0.127073113758
Original return rate: 0.226925459426
########################################
Timestamp: 2017-03-02T10:08:51GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_67', 'pca_comp_62', 'pca_comp_66', 'pca_comp_10', 'BuyerID_numReturnedNotNull', 'pca_comp_01', 'SellerID_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'pca_comp_04', 'VIN_numDSEligible1', 'SellerID_numReturnedasm1', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_64', 'pca_comp_58', 'pca_comp_09', 'Arbitrated', 'pca_cluster_0_dist', 'pca_comp_46', 'BuyerID_numReturned1', 'cluster_0_dist', 'pca_comp_29', 'pca_comp_61', 'pca_comp_25', 'BuyerID_fracReturned1DivReturnedNotNull', 'VIN_numReturnedasm1', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_40', 'pca_comp_03', 'SalePrice', 'pca_comp_60', 'pca_comp_12', 'VIN_numTransactions', 'pca_comp_63', 'pca_comp_48', 'pca_comp_19', 'pca_comp_52', 'JDPowersCat_SPORTSCAR', 'pca_comp_06', 'MMR', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_33', 'pca_comp_53', 'JDPowersCat_numTransactions', 'pca_comp_34', 'pca_comp_08', 'pca_comp_30', 'pca_comp_56', 'JDPowersCat_numReturnedasm1', 'pca_comp_44', 'pca_comp_45', 'JDPowersCat_numReturnedNotNull', 'BuyerID_numDSEligible1', 'SellerID_numDSEligible1', 'SellerID_numTransactions', 'pca_cluster_1_dist', 'cluster_1_dist', 'CarMake_fracDSEligible1DivTransactions', 'SellerID_numReturned1', 'LIGHTR', 'pca_comp_13', 'SellerID_fracReturnedasm1DivTransactions', 'pca_comp_54', 'Mileage', 'pca_comp_26', 'pca_comp_69', 'pca_comp_02', 'pca_comp_00', 'pca_comp_43', 'LIGHT_N0G1Y2R3', 'JDPowersCat_numDSEligible1']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5913.000000 5913.000000
mean 0.098512 0.104854
std 0.293687 0.310231
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull \
count 5913.000000 5913.000000
mean 0.073398 0.029427
std 0.260810 0.168512
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_fracReturnedasm1DivTransactions
count 5913.000000
mean 0.077879
std 0.261841
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.997
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.995
Chunk:
Evaluation time span: 2013-08-04 00:00:00 2013-08-10 00:00:00
Model return rate: 0.0
Original return rate: 0.252727272727
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-08-10 00:00:00
Model return rate: 0.115942028986
Original return rate: 0.229556832932
########################################
Timestamp: 2017-03-02T10:08:59GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_numReturnedasm1', 'pca_comp_53', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_52', 'SellerID_numReturnedasm1', 'pca_comp_68', 'pca_comp_01', 'pca_comp_60', 'BuyerID_numReturnedNotNull', 'SellerID_numReturned1', 'pca_comp_38', 'pca_comp_58', 'Returned_asm', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'SellerID_fracReturned1DivReturnedNotNull', 'VIN_numTransactions', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_65', 'cluster', 'DSEligible', 'PSIEligible', 'VIN_numReturned1', 'Autocheck_score', 'LIGHT_N0G1Y2R3', 'pca_comp_25', 'pca_comp_15', 'pca_comp_63', 'LIGHTR', 'pca_comp_11', 'SellerID_fracDSEligible1DivTransactions', 'BuyerID_numReturned1', 'pca_comp_23', 'pca_comp_16', 'MMR', 'pca_comp_07', 'pca_comp_20', 'pca_comp_69', 'pca_cluster_1_dist', 'pca_comp_41', 'pca_comp_22', 'pca_comp_37', 'pca_comp_27', 'pca_comp_17', 'pca_comp_66', 'pca_comp_47', 'pca_comp_10', 'pca_comp_05', 'SellerID_numTransactions', 'Mileage', 'cluster_0_dist', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'CarMake_fracDSEligible1DivTransactions', 'BuyerID_fracReturned1DivReturnedNotNull']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6161.000000 6161.00000
mean 0.068035 0.07304
std 0.247775 0.26394
min 0.000000 0.00000
25% 0.000000 0.00000
50% 0.000000 0.00000
75% 0.000000 0.00000
max 1.000000 2.00000
VIN_numReturnedasm1 pca_comp_53 VIN_fracReturned1DivReturnedNotNull
count 6161.000000 6.161000e+03 6161.000000
mean 0.088297 -1.413570e-17 0.003814
std 0.288290 7.290043e-02 0.060652
min 0.000000 -4.557946e-01 0.000000
25% 0.000000 -9.764019e-03 0.000000
50% 0.000000 -2.045005e-03 0.000000
75% 0.000000 6.489227e-03 0.000000
max 3.000000 1.263895e+00 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.994
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.584
Chunk:
Evaluation time span: 2013-08-11 00:00:00 2013-08-17 00:00:00
Model return rate: 0.230529595016
Original return rate: 0.230529595016
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-08-17 00:00:00
Model return rate: 0.129733783277
Original return rate: 0.22966031483
########################################
Timestamp: 2017-03-02T10:09:07GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_66', 'VIN_fracReturnedasm1DivTransactions', 'SellerID_numReturnedasm1', 'pca_comp_61', 'VIN_numTransactions', 'pca_comp_01', 'BuyerID_numReturnedNotNull', 'pca_comp_33', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'VIN_numDSEligible1', 'pca_comp_34', 'pca_comp_56', 'BuyerID_numReturned1', 'pca_comp_12', 'pca_cluster_1_dist', 'Arbitrated', 'SellerID_fracReturned1DivReturnedNotNull', 'SellerID_numDSEligible1', 'cluster_1_dist', 'VIN_numReturned1', 'pca_comp_41', 'pca_comp_02', 'pca_comp_62', 'SellerID_numTransactions', 'pca_comp_19', 'pca_comp_04', 'pca_comp_00', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_37', 'pca_comp_21', 'pca_comp_47', 'pca_comp_65', 'pca_comp_63', 'pca_comp_60', 'pca_comp_38', 'pca_comp_51', 'VIN_numReturnedasm1', 'pca_comp_52', 'BuyerID_fracReturnedasm1DivTransactions', 'SellerID_numReturned1', 'LIGHTR', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_27', 'pca_comp_48', 'pca_comp_67', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_32', 'pca_comp_07', 'CarYear', 'cluster_0_dist', 'pca_comp_70', 'pca_comp_11', 'pca_comp_43', 'pca_comp_08', 'pca_comp_58', 'pca_comp_72', 'BuyerID_fracReturned1DivReturnedNotNull', 'SellerID_fracDSEligible1DivTransactions', 'SellerID_fracReturnedasm1DivTransactions', 'JDPowersCat_numReturnedNotNull', 'pca_comp_64', 'MMR', 'pca_comp_15', 'pca_comp_10', 'pca_comp_03', 'pca_comp_39', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_24', 'Autocheck_score', 'pca_comp_45', 'pca_comp_06', 'pca_comp_55', 'pca_comp_23', 'SaleDate_decyear', 'BuyerID_numDSEligible1', 'pca_comp_53', 'pca_comp_59', 'pca_comp_28', 'Mileage', 'JDPowersCat_numTransactions', 'pca_comp_30', 'pca_comp_22', 'CarMake_fracReturnedasm1DivTransactions', 'CarMake_fracDSEligible1DivTransactions']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 Returned_asm \
count 6503.000000 6503.000000
mean 0.100351 0.078887
std 0.296334 0.269583
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_numReturnedNotNull VIN_fracReturned1DivReturnedNotNull \
count 6503.000000 6503.000000
mean 0.106874 0.027141
std 0.313424 0.162152
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 2.000000 1.000000
pca_comp_66
count 6.503000e+03
mean -2.052982e-18
std 9.090636e-03
min -2.504469e-01
25% -7.261761e-04
50% 6.435760e-05
75% 7.087362e-04
max 1.260821e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.997
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.982
Chunk:
Evaluation time span: 2013-08-18 00:00:00 2013-08-24 00:00:00
Model return rate: 0.0
Original return rate: 0.184568835098
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-08-24 00:00:00
Model return rate: 0.117827345479
Original return rate: 0.225209080048
########################################
Timestamp: 2017-03-02T10:09:15GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_60', 'pca_comp_35', 'pca_comp_49', 'pca_comp_34', 'DSEligible', 'pca_cluster_0_dist', 'Returned_asm', 'cluster_0_dist', 'pca_comp_58', 'pca_comp_63', 'SellingLocation_lon', 'VIN_numReturned1', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_39', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_11', 'pca_comp_66', 'VIN_numReturnedasm1', 'BuyerID_numReturnedNotNull', 'pca_comp_37', 'pca_comp_13', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_02', 'SellingLocation_lat', 'pca_comp_14', 'VIN_fracDSEligible1DivTransactions', 'PSIEligible', 'BuyerID_numReturned1', 'pca_comp_09', 'pca_comp_64', 'pca_comp_29', 'CarYear', 'pca_comp_19', 'SellerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_numReturnedasm1', 'SellingLocation_numTransactions', 'pca_comp_47', 'pca_comp_52', 'pca_comp_55', 'pca_comp_45', 'SellingLocation_numDSEligible1', 'pca_comp_08', 'pca_comp_27', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_10', 'VIN_numTransactions', 'pca_comp_18', 'SellerID_numReturnedasm1', 'SellingLocation_numReturnedasm1', 'pca_comp_61', 'pca_comp_01', 'pca_comp_28', 'SellerID_fracReturnedasm1DivTransactions', 'SalePrice', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_05', 'SellerID_fracDSEligible1DivTransactions', 'Mileage', 'VIN_numDSEligible1', 'pca_comp_24', 'pca_comp_36', 'SellingLocation_numReturnedNotNull']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6216.000000 6216.000000
mean 0.089125 0.095560
std 0.280361 0.297817
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull pca_comp_60 pca_comp_35
count 6216.000000 6.216000e+03 6.216000e+03
mean 0.006113 7.557322e-19 -2.120962e-17
std 0.076391 2.712373e-02 3.110510e-01
min 0.000000 -5.443008e-01 -1.538647e+00
25% 0.000000 -3.803259e-03 -1.799287e-01
50% 0.000000 -1.545376e-03 -2.196175e-02
75% 0.000000 1.652658e-03 1.388972e-01
max 1.000000 2.317003e-01 2.139217e+00
Progress: 20% 40% 60% 80% 100%
Model score = 0.994
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.562
Chunk:
Evaluation time span: 2013-08-25 00:00:00 2013-08-31 00:00:00
Model return rate: 0.225543478261
Original return rate: 0.225543478261
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-08-31 00:00:00
Model return rate: 0.129822968679
Original return rate: 0.22524219591
########################################
Timestamp: 2017-03-02T10:09:23GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_66', 'pca_comp_61', 'VIN_numReturned1', 'DSEligible', 'pca_comp_64', 'pca_comp_62', 'pca_comp_70', 'pca_comp_46', 'pca_comp_39', 'pca_comp_36', 'pca_comp_53', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_71', 'pca_comp_32', 'pca_comp_59', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_42', 'CarMake_numReturned1', 'pca_comp_44', 'pca_comp_50', 'pca_comp_56', 'BuyerID_numTransactions', 'pca_comp_11', 'BuyerID_numReturnedasm1', 'VIN_numReturnedasm1', 'pca_comp_72', 'CarMake_numReturnedasm1', 'pca_comp_49', 'pca_comp_37', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_35', 'SellerID_fracReturnedasm1DivTransactions', 'pca_comp_02', 'pca_comp_47', 'pca_comp_45', 'BuyerID_fracDSEligible1DivTransactions', 'CarMake_numReturnedNotNull', 'JDPowersCat_numDSEligible1', 'CarMake_numTransactions', 'SellingLocation_lon', 'SellerID_fracReturned1DivReturnedNotNull', 'cluster_1_dist', 'pca_comp_51', 'BuyerID_numDSEligible1', 'pca_comp_60', 'SellingLocation_fracReturned1DivReturnedNotNull', 'pca_comp_27', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'pca_comp_58', 'JDPowersCat_numReturned1', 'pca_comp_29', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_34', 'SellingLocation_numReturnedasm1', 'CarMake_numDSEligible1', 'SellingLocation_lat', 'SellingLocation_numReturned1', 'pca_comp_04', 'pca_comp_14', 'pca_comp_43', 'SalePrice', 'pca_comp_38', 'Mileage', 'JDPowersCat_numReturnedNotNull', 'JDPowersCat_numTransactions', 'JDPowersCat_fracReturned1DivReturnedNotNull', 'pca_comp_03', 'pca_comp_09', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_01', 'SellingLocation_numReturnedNotNull', 'pca_comp_57', 'MMR', 'pca_comp_69', 'pca_comp_17', 'pca_comp_28', 'pca_cluster_0_dist', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_33', 'pca_comp_63', 'BuyerID_fracReturnedasm1DivTransactions', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_22', 'JDPowersCat_fracDSEligible1DivTransactions', 'SellerID_numReturned1', 'pca_comp_07', 'JDPowersCat_LUXURYCAR', 'pca_comp_05', 'pca_comp_19', 'JDPowersCat_PICKUP', 'pca_comp_41', 'pca_comp_67', 'SellerID_numReturnedNotNull', 'SaleDate_dow', 'SellingLocation_numDSEligible1', 'JDPowersCat_numReturnedasm1', 'pca_comp_15', 'cluster', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_55', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_24', 'pca_comp_20', 'pca_comp_21', 'CarMake_fracReturnedasm1DivTransactions', 'BuyerID_numReturnedNotNull', 'pca_comp_06', 'pca_comp_31', 'pca_comp_54', 'pca_comp_23', 'pca_comp_18', 'SellingLocation_fracDSEligible1DivTransactions', 'VIN_numTransactions', 'pca_comp_65', 'pca_comp_52', 'CarYear', 'pca_comp_08', 'SellerID_numReturnedasm1', 'SellerID_numTransactions', 'BuyerID_numReturned1', 'pca_comp_26', 'JDPowersCat_fracReturnedasm1DivTransactions', 'pca_comp_68']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6331.000000 6331.000000
mean 0.116990 0.125888
std 0.316842 0.340677
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_66
count 6331.000000 6331.000000 6.331000e+03
mean 0.091771 0.031906 -1.117285e-17
std 0.288725 0.175090 9.898213e-03
min 0.000000 0.000000 -1.837539e-01
25% 0.000000 0.000000 -8.687123e-04
50% 0.000000 0.000000 -2.442378e-05
75% 0.000000 0.000000 6.976617e-04
max 1.000000 1.000000 2.311562e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.990
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.994
Chunk:
Evaluation time span: 2013-09-01 00:00:00 2013-09-07 00:00:00
Model return rate: 0.0
Original return rate: 0.193602693603
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-09-07 00:00:00
Model return rate: 0.1210496614
Original return rate: 0.222900573137
########################################
Timestamp: 2017-03-02T10:09:32GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'pca_comp_51', 'pca_comp_13', 'pca_comp_59', 'pca_comp_26', 'Returned_asm', 'pca_comp_66', 'DSEligible', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_27', 'pca_comp_58', 'pca_comp_57', 'pca_comp_15', 'cluster_1_dist', 'pca_comp_53', 'pca_comp_52', 'pca_comp_65', 'pca_cluster', 'pca_comp_41', 'pca_cluster_0_dist', 'pca_comp_47', 'BuyerID_numDSEligible1', 'pca_cluster_1_dist', 'cluster', 'BuyerID_numTransactions', 'SellingLocation_fracReturnedasm1DivTransactions', 'VIN_numTransactions', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_23', 'JDPowersCat_numReturnedasm1', 'pca_comp_08', 'pca_comp_56', 'pca_comp_11', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'pca_comp_48', 'SellingLocation_fracDSEligible1DivTransactions', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_40', 'pca_comp_67', 'pca_comp_09']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5026.000000 5026.000000
mean 0.096896 0.102268
std 0.292860 0.308240
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturned1 pca_comp_51
count 5026.000000 5026.000000 5.026000e+03
mean 0.003880 0.003979 7.573970e-18
std 0.061772 0.062962 9.247145e-02
min 0.000000 0.000000 -4.871721e-01
25% 0.000000 0.000000 -1.715146e-02
50% 0.000000 0.000000 3.905734e-03
75% 0.000000 0.000000 2.302979e-02
max 1.000000 1.000000 1.228385e+00
Progress: 20% 40% 60% 80% 100%
Model score = 0.993
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.404
Chunk:
Evaluation time span: 2013-09-08 00:00:00 2013-09-14 00:00:00
Model return rate: 0.221621621622
Original return rate: 0.221621621622
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-09-14 00:00:00
Model return rate: 0.130556974962
Original return rate: 0.222792607803
########################################
Timestamp: 2017-03-02T10:09:40GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_64', 'pca_comp_60', 'pca_comp_66', 'VIN_numReturned1', 'pca_comp_61', 'pca_comp_47', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_11', 'VIN_numTransactions', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_55', 'Arbitrated', 'pca_comp_30', 'VIN_numReturnedasm1', 'pca_comp_54', 'pca_comp_00', 'pca_comp_48', 'pca_comp_52', 'pca_comp_28', 'pca_comp_26', 'pca_cluster_0_dist', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_24', 'pca_comp_18', 'BuyerID_numDSEligible1', 'VIN_numDSEligible1', 'pca_comp_41', 'pca_comp_14', 'pca_comp_56', 'CarMake_fracReturnedNotNullDivDSEligible1', 'cluster_1_dist', 'BuyerID_numTransactions', 'pca_comp_38', 'pca_comp_37', 'pca_comp_32', 'pca_comp_33', 'SellerID_numReturnedasm1', 'pca_comp_04', 'pca_comp_23', 'pca_comp_34', 'pca_comp_70', 'BuyerID_numReturned1', 'SellingLocation_fracReturned1DivReturnedNotNull', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_68', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_19', 'BuyerID_numReturnedNotNull', 'pca_comp_31', 'pca_comp_06', 'pca_cluster_1_dist', 'pca_comp_15', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_63', 'pca_comp_71', 'pca_comp_07', 'pca_comp_05', 'pca_comp_44', 'pca_comp_67', 'pca_comp_09', 'SellingLocation_numTransactions', 'pca_comp_29', 'SellingLocation_lat', 'cluster_0_dist', 'pca_comp_59', 'SellingLocation_numReturned1', 'pca_comp_27', 'JDPowersCat_SUV', 'SellerID_fracReturnedasm1DivTransactions', 'SellingLocation_fracReturnedasm1DivTransactions', 'pca_comp_46', 'CarMake_numDSEligible1', 'cluster', 'JDPowersCat_numReturnedNotNull', 'SellerID_numReturned1', 'pca_comp_39', 'CarMake_numTransactions', 'JDPowersCat_fracReturnedasm1DivTransactions', 'pca_comp_50', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'BuyerID_fracReturned1DivReturnedNotNull', 'JDPowersCat_fracDSEligible1DivTransactions', 'pca_comp_22', 'pca_comp_49', 'pca_comp_62', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_40', 'JDPowersCat_numReturned1', 'pca_comp_13', 'pca_comp_03', 'SellingLocation_numReturnedNotNull', 'pca_comp_25', 'pca_comp_58', 'JDPowersCat_PICKUP', 'LIGHTR', 'pca_comp_57', 'SellerID_numReturnedNotNull', 'pca_comp_51', 'pca_comp_43', 'JDPowersCat_numDSEligible1', 'SellerID_numDSEligible1', 'SaleDate_doy', 'pca_comp_69', 'pca_comp_17', 'pca_comp_53', 'BuyerID_numReturnedasm1', 'CarMake_numReturned1', 'MMR', 'pca_comp_01', 'DSEligible', 'SalePrice', 'Autocheck_score', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_10', 'pca_comp_42', 'pca_comp_08', 'JDPowersCat_numReturnedasm1', 'pca_comp_65', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_16', 'pca_comp_02', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_36', 'CarYear', 'JDPowersCat_numTransactions', 'CarMake_numReturnedNotNull']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6598.000000 6598.000000
mean 0.112029 0.120491
std 0.310834 0.332926
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_64
count 6598.000000 6598.000000 6.598000e+03
mean 0.086693 0.029479 9.725777e-19
std 0.281406 0.168371 1.475371e-02
min 0.000000 0.000000 -5.620931e-01
25% 0.000000 0.000000 -7.779020e-04
50% 0.000000 0.000000 1.325380e-04
75% 0.000000 0.000000 9.685702e-04
max 1.000000 1.000000 1.351816e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.997
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.993
Chunk:
Evaluation time span: 2013-09-15 00:00:00 2013-09-21 00:00:00
Model return rate: 0.0
Original return rate: 0.235378031384
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-09-21 00:00:00
Model return rate: 0.12219033955
Original return rate: 0.223724516742
########################################
Timestamp: 2017-03-02T10:09:49GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'pca_comp_50', 'pca_comp_35', 'pca_comp_58', 'DSEligible', 'pca_comp_59', 'Returned_asm', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_53', 'pca_comp_62', 'VIN_numDSEligible1', 'BuyerID_numReturnedNotNull', 'SellerID_fracDSEligible1DivTransactions', 'pca_cluster_1_dist', 'pca_comp_48', 'pca_comp_00', 'BuyerID_numDSEligible1', 'pca_comp_66', 'BuyerID_numTransactions', 'pca_comp_02', 'pca_comp_65', 'pca_comp_40', 'SaleDate_day', 'VIN_fracDSEligible1DivTransactions', 'SellerID_fracReturnedasm1DivTransactions', 'SellerID_numReturnedNotNull', 'cluster_1_dist', 'pca_comp_21', 'SellerID_numTransactions', 'pca_cluster_0_dist', 'pca_comp_10', 'pca_comp_12', 'pca_comp_63', 'pca_comp_60', 'pca_comp_37', 'SaleDate_doy', 'SaleDate_decyear', 'pca_comp_30', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_01', 'cluster', 'VIN_numReturnedasm1', 'BuyerID_fracReturned1DivReturnedNotNull', 'SellerID_numDSEligible1', 'cluster_0_dist', 'pca_comp_51', 'pca_comp_34', 'pca_comp_25', 'Mileage']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6112.000000 6112.000000
mean 0.089469 0.095223
std 0.281728 0.297423
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturned1 pca_comp_50
count 6112.000000 6112.000000 6.112000e+03
mean 0.004745 0.005236 -4.302395e-19
std 0.067523 0.074406 9.815489e-02
min 0.000000 0.000000 -6.552332e-01
25% 0.000000 0.000000 -2.470966e-02
50% 0.000000 0.000000 3.683626e-03
75% 0.000000 0.000000 3.089828e-02
max 1.000000 2.000000 1.511555e+00
Progress: 20% 40% 60% 80% 100%
Model score = 0.993
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.497
Chunk:
Evaluation time span: 2013-09-22 00:00:00 2013-09-28 00:00:00
Model return rate: 0.198550724638
Original return rate: 0.198550724638
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-09-28 00:00:00
Model return rate: 0.128009719461
Original return rate: 0.222014374323
########################################
Timestamp: 2017-03-02T10:09:58GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'VIN_numReturnedNotNull', 'pca_comp_66', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_64', 'SellerID_numReturned1', 'SellingLocation_lat', 'pca_comp_60', 'VIN_numReturned1', 'SellingLocation_lon', 'pca_comp_00', 'pca_comp_61', 'SellerID_numReturnedasm1', 'BuyerID_numReturnedNotNull', 'pca_comp_25', 'pca_comp_38', 'pca_comp_31', 'VIN_fracReturnedasm1DivTransactions', 'VIN_numTransactions', 'pca_comp_01', 'BuyerID_fracReturned1DivReturnedNotNull', 'cluster', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_14', 'VIN_numDSEligible1', 'pca_comp_40', 'VIN_numReturnedasm1', 'pca_comp_51', 'SellingLocation_numReturnedasm1', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_52', 'pca_comp_02', 'pca_comp_59', 'pca_cluster_0_dist', 'pca_comp_33', 'SellingLocation_numReturned1', 'cluster_0_dist', 'pca_comp_06', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_50', 'pca_comp_47', 'SellingLocation_numReturnedNotNull', 'pca_comp_35', 'pca_comp_13', 'JDPowersCat_VAN', 'pca_comp_63', 'pca_comp_09', 'pca_comp_68', 'JDPowersCat_numReturnedasm1', 'pca_comp_18', 'VIN_fracDSEligible1DivTransactions', 'BuyerID_numDSEligible1', 'SellingLocation_numTransactions', 'pca_comp_53', 'pca_comp_27', 'pca_comp_69', 'LIGHTR', 'pca_comp_49', 'SellingLocation_numDSEligible1', 'SellerID_numReturnedNotNull', 'pca_comp_46', 'pca_comp_08', 'CarYear', 'pca_comp_32', 'pca_comp_11', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_12', 'pca_comp_37', 'pca_comp_29', 'pca_comp_10', 'BuyerID_numReturned1', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_48', 'SalePrice', 'pca_comp_62', 'pca_cluster_1_dist', 'pca_comp_45', 'pca_comp_24', 'pca_comp_71', 'pca_comp_16', 'JDPowersCat_fracDSEligible1DivTransactions', 'SellerID_numDSEligible1', 'Autocheck_score', 'SaleDate_doy', 'SaleDate_decyear', 'pca_comp_05', 'JDPowersCat_numReturned1', 'pca_comp_56', 'pca_comp_04', 'pca_comp_22', 'BuyerID_numTransactions', 'SellingLocation_fracReturned1DivReturnedNotNull', 'BuyerID_fracDSEligible1DivTransactions', 'pca_comp_26', 'pca_comp_42', 'pca_comp_43', 'pca_comp_58', 'CarMake_fracReturnedNotNullDivDSEligible1', 'Arbitrated', 'pca_comp_17', 'JDPowersCat_fracReturned1DivReturnedNotNull', 'SaleDate_dow', 'pca_comp_07', 'JDPowersCat_numReturnedNotNull', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_30', 'pca_comp_65', 'pca_comp_15', 'pca_comp_54', 'SellerID_fracReturnedasm1DivTransactions']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 Returned_asm \
count 5919.000000 5919.000000
mean 0.118587 0.089035
std 0.318143 0.284819
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 1.000000
VIN_numReturnedNotNull pca_comp_66 \
count 5919.000000 5.919000e+03
mean 0.128569 -1.726563e-17
std 0.343717 1.124832e-02
min 0.000000 -2.498508e-01
25% 0.000000 -1.036708e-03
50% 0.000000 -6.866202e-06
75% 0.000000 9.006167e-04
max 2.000000 1.205782e-01
VIN_fracReturned1DivReturnedNotNull
count 5919.000000
mean 0.029904
std 0.169341
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.997
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.988
Chunk:
Evaluation time span: 2013-09-29 00:00:00 2013-10-05 00:00:00
Model return rate: 0.0
Original return rate: 0.236694677871
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-10-05 00:00:00
Model return rate: 0.120741743932
Original return rate: 0.222978566829
########################################
Timestamp: 2017-03-02T10:10:08GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturnedasm1', 'VIN_numReturnedNotNull', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_60', 'VIN_numReturned1', 'pca_comp_24', 'pca_comp_14', 'pca_comp_58', 'DSEligible', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_38', 'Returned_asm', 'pca_comp_37', 'pca_comp_67', 'pca_comp_48', 'pca_comp_52', 'pca_comp_63', 'SellerID_fracReturnedNotNullDivDSEligible1', 'VIN_numTransactions', 'pca_comp_36', 'pca_comp_34', 'pca_comp_55', 'pca_comp_57', 'pca_comp_56', 'pca_comp_00', 'BuyerID_numReturned1', 'pca_comp_21', 'SaleDate_day', 'SaleDate_dow', 'SalePrice', 'SellerID_fracReturnedasm1DivTransactions', 'SaleDate_decyear', 'pca_comp_53', 'JDPowersCat_PICKUP', 'pca_cluster_0_dist', 'Autocheck_score', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_30', 'JDPowersCat_MIDSIZECAR', 'MMR', 'pca_comp_02', 'pca_comp_25', 'pca_comp_42', 'SellingLocation_numReturnedasm1', 'pca_comp_29', 'pca_comp_07', 'BuyerID_fracReturned1DivReturnedNotNull', 'VIN_fracDSEligible1DivTransactions', 'BuyerID_numReturnedasm1', 'pca_comp_18', 'SaleDate_doy', 'cluster_0_dist', 'SellingLocation_fracReturnedasm1DivTransactions', 'SellingLocation_numReturnedNotNull', 'pca_comp_22', 'pca_comp_03', 'pca_comp_10', 'pca_comp_19', 'pca_comp_41', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_12', 'SellingLocation_numDSEligible1', 'SellingLocation_fracReturned1DivReturnedNotNull', 'pca_comp_13', 'pca_comp_65', 'CarYear', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_68', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_50', 'SellerID_numTransactions', 'pca_comp_01', 'CarMake_fracReturnedasm1DivTransactions', 'VIN_numDSEligible1', 'pca_cluster_1_dist', 'pca_comp_46', 'BuyerID_numReturnedNotNull', 'pca_comp_40', 'pca_comp_27']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 \
count 5821.000000
mean 0.098279
std 0.291236
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturnedasm1 \
count 5821.000000 5821.000000
mean 0.010222 0.108057
std 0.099950 0.316508
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_numReturnedNotNull VIN_fracReturnedasm1DivTransactions
count 5821.000000 5821.000000
mean 0.107542 0.093211
std 0.314779 0.279869
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 3.000000 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.987
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.450
Chunk:
Evaluation time span: 2013-10-06 00:00:00 2013-10-12 00:00:00
Model return rate: 0.260740740741
Original return rate: 0.260740740741
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-10-12 00:00:00
Model return rate: 0.129939653494
Original return rate: 0.225186211675
########################################
Timestamp: 2017-03-02T10:10:17GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_64', 'DSEligible', 'pca_comp_61', 'pca_comp_59', 'VIN_numReturned1', 'VIN_numReturnedasm1', 'pca_comp_66', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_52', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_37', 'pca_comp_46', 'pca_comp_31', 'pca_comp_02', 'pca_comp_36', 'Arbitrated', 'pca_comp_38', 'cluster_1_dist', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_numTransactions', 'pca_comp_32', 'cluster_0_dist', 'SellingLocation_numDSEligible1', 'VIN_numTransactions', 'BuyerID_numDSEligible1', 'pca_comp_45', 'pca_comp_67', 'SellingLocation_fracReturned1DivReturnedNotNull', 'pca_comp_65', 'pca_comp_69', 'pca_comp_51', 'VIN_numDSEligible1', 'pca_cluster_0_dist', 'SellingLocation_numReturnedNotNull', 'pca_comp_20', 'pca_comp_26', 'pca_comp_01', 'pca_comp_06', 'SellingLocation_numReturned1', 'SellingLocation_numReturnedasm1', 'pca_comp_33', 'pca_comp_30', 'pca_comp_57', 'SellerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_numReturnedNotNull', 'pca_comp_34', 'pca_comp_12', 'SellerID_numDSEligible1', 'pca_comp_42', 'pca_comp_58', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'SellingLocation_numTransactions', 'pca_comp_47', 'SellingLocation_fracDSEligible1DivTransactions', 'JDPowersCat_SUV', 'SellerID_numReturnedNotNull', 'pca_comp_22', 'pca_comp_24', 'CarYear', 'pca_comp_10', 'pca_comp_23', 'CarMake_fracReturned1DivReturnedNotNull']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5924.000000 5924.000000
mean 0.115856 0.125591
std 0.314463 0.337973
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_64
count 5924.000000 5924.000000 5.924000e+03
mean 0.087441 0.037643 2.415318e-17
std 0.282504 0.189682 1.449465e-02
min 0.000000 0.000000 -2.194927e-01
25% 0.000000 0.000000 -1.527965e-03
50% 0.000000 0.000000 -5.345464e-05
75% 0.000000 0.000000 1.274495e-03
max 1.000000 1.000000 2.330418e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.995
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.995
Chunk:
Evaluation time span: 2013-10-13 00:00:00 2013-10-19 00:00:00
Model return rate: 0.0
Original return rate: 0.280575539568
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-10-19 00:00:00
Model return rate: 0.123909411546
Original return rate: 0.228331018708
########################################
Timestamp: 2017-03-02T10:10:26GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturnedasm1', 'VIN_fracReturnedasm1DivTransactions', 'Returned_asm', 'pca_comp_56', 'DSEligible', 'pca_comp_53', 'pca_comp_59', 'VIN_numReturned1', 'pca_comp_63', 'pca_comp_49', 'pca_comp_15', 'pca_comp_34', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_numDSEligible1', 'pca_comp_57', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_37', 'pca_comp_13', 'BuyerID_numTransactions', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_66', 'PSI', 'VIN_numDSEligible1', 'pca_comp_04', 'CarMake_numReturnedNotNull', 'pca_comp_40', 'Arbitrated', 'pca_comp_48', 'pca_comp_67', 'pca_comp_02', 'CarMake_numReturned1', 'pca_comp_29', 'pca_comp_31', 'pca_comp_70', 'pca_comp_33', 'SellingLocation_numTransactions', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'SellingLocation_fracDSEligible1DivTransactions', 'VIN_numTransactions', 'SellingLocation_lat', 'CarMake_numTransactions', 'pca_comp_43', 'pca_comp_62', 'SellingLocation_numReturned1', 'pca_comp_65', 'pca_comp_01', 'CarMake_fracReturnedasm1DivTransactions', 'pca_comp_68', 'JDPowersCat_numTransactions', 'CarMake_fracReturnedNotNullDivDSEligible1', 'pca_comp_23', 'JDPowersCat_numDSEligible1', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_36', 'CarMake_numDSEligible1', 'JDPowersCat_numReturnedasm1', 'pca_comp_03', 'pca_comp_58', 'CarYear', 'CarMake_numReturnedasm1', 'pca_comp_61', 'SellingLocation_numReturnedasm1', 'JDPowersCat_SUV', 'MMR', 'JDPowersCat_SPORTSCAR', 'pca_comp_44', 'JDPowersCat_fracReturnedasm1DivTransactions', 'JDPowersCat_numReturned1', 'Mileage', 'pca_comp_07', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_cluster_0_dist', 'pca_comp_11', 'pca_comp_17', 'pca_cluster', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_54', 'JDPowersCat_numReturnedNotNull']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5737.000000 5737.000000
mean 0.090030 0.096915
std 0.282151 0.302856
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturnedasm1 \
count 5737.000000 5737.000000
mean 0.006014 0.100924
std 0.075322 0.306418
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturnedasm1DivTransactions
count 5737.000000
mean 0.089550
std 0.277042
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.985
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.526
Chunk:
Evaluation time span: 2013-10-20 00:00:00 2013-10-26 00:00:00
Model return rate: 0.238993710692
Original return rate: 0.238993710692
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-10-26 00:00:00
Model return rate: 0.131817788919
Original return rate: 0.228981282602
########################################
Timestamp: 2017-03-02T10:10:35GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_63', 'pca_comp_67', 'pca_comp_60', 'VIN_numReturned1', 'pca_comp_61', 'Arbitrated', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'VIN_numTransactions', 'VIN_numDSEligible1', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_25', 'pca_comp_00', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_54', 'VIN_numReturnedasm1', 'BuyerID_numReturnedNotNull', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_42', 'pca_comp_46', 'pca_comp_05', 'pca_comp_40', 'pca_comp_06', 'pca_comp_30', 'pca_comp_34', 'MMR', 'pca_comp_59', 'pca_comp_53']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6152.000000 6152.000000
mean 0.130188 0.141905
std 0.330630 0.359536
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 3.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_63
count 6152.000000 6152.000000 6.152000e+03
mean 0.093791 0.038064 -1.378770e-17
std 0.291561 0.190312 1.996559e-02
min 0.000000 0.000000 -4.822711e-01
25% 0.000000 0.000000 -3.113831e-03
50% 0.000000 0.000000 2.611920e-05
75% 0.000000 0.000000 3.063983e-03
max 1.000000 1.000000 2.100999e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.993
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.983
Chunk:
Evaluation time span: 2013-10-27 00:00:00 2013-11-02 00:00:00
Model return rate: 0.0
Original return rate: 0.236220472441
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-11-02 00:00:00
Model return rate: 0.125504073739
Original return rate: 0.22938106972
########################################
Timestamp: 2017-03-02T10:10:45GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_numReturnedasm1', 'VIN_fracReturnedasm1DivTransactions', 'DSEligible', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_63', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'pca_comp_38', 'pca_comp_51', 'pca_comp_55', 'pca_comp_69', 'VIN_numReturned1', 'pca_comp_40', 'pca_comp_54', 'VIN_numTransactions', 'pca_comp_57', 'pca_comp_58', 'pca_comp_33', 'pca_comp_48', 'pca_comp_03', 'pca_comp_70', 'pca_comp_26', 'pca_comp_59', 'pca_cluster_1_dist', 'pca_comp_15', 'BuyerID_numReturned1', 'pca_comp_65', 'BuyerID_numReturnedNotNull', 'cluster_1_dist', 'SellerID_numReturnedasm1', 'cluster_0_dist', 'pca_comp_01', 'SellerID_numReturned1', 'pca_comp_21', 'pca_comp_00', 'InLane', 'pca_comp_47', 'pca_cluster_0_dist', 'pca_comp_19', 'CarYear', 'pca_comp_44', 'pca_comp_50', 'pca_comp_64', 'pca_comp_34', 'pca_comp_72', 'pca_comp_62', 'pca_comp_18', 'BuyerID_numDSEligible1', 'pca_comp_27', 'pca_comp_24', 'pca_comp_10', 'pca_comp_17', 'pca_comp_73', 'pca_comp_32', 'pca_comp_13', 'CarMake_numReturned1', 'CarMake_numReturnedasm1', 'pca_comp_37', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_49', 'pca_comp_68', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_76', 'SaleDate_decyear', 'pca_comp_41', 'BuyerID_fracReturned1DivReturnedNotNull', 'SellerID_numDSEligible1', 'VIN_numDSEligible1', 'SellerID_fracReturned1DivReturnedNotNull', 'JDPowersCat_MIDSIZECAR', 'pca_comp_08', 'pca_comp_60', 'pca_comp_67', 'pca_comp_53', 'Mileage', 'pca_comp_56', 'pca_comp_29', 'pca_comp_52', 'pca_comp_11', 'pca_comp_30', 'MMR', 'BuyerID_numReturnedasm1', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_07', 'BuyerID_numTransactions', 'JDPowersCat_fracReturnedasm1DivTransactions', 'JDPowersCat_COMPACTCAR', 'pca_comp_06', 'pca_comp_04', 'pca_comp_25', 'Autocheck_score', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'JDPowersCat_LUXURYCAR', 'JDPowersCat_numTransactions', 'SellingLocation_numReturnedNotNull', 'pca_comp_45']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 5519.000000 5519.000000
mean 0.107477 0.114513
std 0.306044 0.325777
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_numReturnedasm1 VIN_fracReturnedasm1DivTransactions DSEligible
count 5519.000000 5519.000000 5519.000000
mean 0.106179 0.097457 0.906686
std 0.312184 0.290763 0.290898
min 0.000000 0.000000 0.000000
25% 0.000000 0.000000 1.000000
50% 0.000000 0.000000 1.000000
75% 0.000000 0.000000 1.000000
max 2.000000 1.000000 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.994
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.658
Chunk:
Evaluation time span: 2013-11-03 00:00:00 2013-11-09 00:00:00
Model return rate: 0.179761904762
Original return rate: 0.179761904762
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-11-09 00:00:00
Model return rate: 0.129012393195
Original return rate: 0.226533679464
########################################
Timestamp: 2017-03-02T10:10:55GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_64', 'pca_comp_69', 'pca_comp_71', 'pca_comp_66', 'VIN_numReturned1', 'DSEligible', 'pca_comp_33', 'pca_comp_38', 'pca_cluster_0_dist', 'pca_comp_60', 'pca_comp_41', 'BuyerID_numReturnedNotNull', 'pca_comp_42', 'cluster_0_dist', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_57', 'pca_comp_09', 'Autocheck_score', 'VIN_numTransactions', 'BuyerID_numReturned1', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_10', 'pca_comp_52', 'PSI', 'cluster_1_dist', 'pca_comp_34', 'VIN_numReturnedasm1', 'pca_cluster_1_dist', 'pca_comp_49', 'pca_comp_30', 'pca_comp_54', 'pca_comp_35', 'pca_comp_65', 'pca_comp_51', 'pca_comp_46', 'pca_comp_00', 'Mileage', 'pca_comp_01', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_72', 'pca_comp_31', 'pca_comp_48', 'JDPowersCat_SPORTSCAR', 'BuyerID_numTransactions', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_07', 'CarYear', 'BuyerID_numReturnedasm1', 'pca_comp_67', 'VIN_fracDSEligible1DivTransactions', 'SellerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_70', 'JDPowersCat_numTransactions', 'pca_comp_06', 'pca_comp_37', 'pca_comp_74', 'pca_comp_43', 'pca_comp_08', 'pca_comp_40', 'pca_comp_75', 'MMR', 'SellingLocation_numReturnedNotNull', 'pca_comp_62', 'VIN_numDSEligible1', 'pca_comp_76', 'BuyerID_fracDSEligible1DivTransactions', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'pca_comp_21', 'BuyerID_numDSEligible1', 'pca_comp_45', 'CarMake_fracReturnedasm1DivTransactions', 'pca_comp_25', 'pca_comp_04', 'pca_comp_44', 'JDPowersCat_numDSEligible1', 'pca_comp_18', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_02', 'pca_comp_19', 'SellerID_numReturned1', 'pca_comp_14', 'SalePrice', 'pca_comp_77', 'pca_comp_22', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_13', 'pca_comp_58', 'pca_comp_05', 'pca_comp_32', 'pca_comp_55', 'pca_comp_50']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6090.000000 6090.000000
mean 0.138820 0.147619
std 0.341631 0.362536
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_64
count 6090.000000 6090.000000 6.090000e+03
mean 0.082430 0.030706 1.381968e-17
std 0.275042 0.171580 3.148035e-02
min 0.000000 0.000000 -2.345634e-01
25% 0.000000 0.000000 -4.228208e-03
50% 0.000000 0.000000 1.266129e-03
75% 0.000000 0.000000 5.727146e-03
max 1.000000 1.000000 6.151397e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.989
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.976
Chunk:
Evaluation time span: 2013-11-10 00:00:00 2013-11-16 00:00:00
Model return rate: 0.0
Original return rate: 0.178717598909
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-11-16 00:00:00
Model return rate: 0.123407701937
Original return rate: 0.224253464316
########################################
Timestamp: 2017-03-02T10:11:06GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturnedasm1', 'pca_comp_64', 'VIN_fracReturnedasm1DivTransactions', 'DSEligible', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'Returned_asm', 'pca_comp_55', 'pca_comp_41', 'pca_comp_50', 'pca_comp_61', 'pca_comp_39', 'VIN_numReturned1', 'pca_comp_09', 'SellerID_numTransactions', 'pca_comp_06', 'pca_comp_68', 'pca_comp_70', 'SellerID_numDSEligible1', 'cluster_0_dist', 'pca_cluster_0_dist', 'pca_comp_00', 'BuyerID_numReturnedNotNull', 'BuyerID_fracDSEligible1DivTransactions', 'CarYear', 'pca_comp_37', 'pca_comp_58', 'CarMake_numReturnedasm1', 'CarMake_numReturnedNotNull', 'pca_comp_67', 'pca_comp_20', 'CarMake_numReturned1', 'pca_comp_13', 'BuyerID_numReturned1', 'pca_comp_48', 'CarMake_numDSEligible1', 'pca_comp_11', 'pca_comp_10', 'pca_comp_23', 'pca_comp_45', 'BuyerID_fracReturned1DivReturnedNotNull', 'VIN_numDSEligible1', 'pca_comp_36', 'VIN_numTransactions', 'pca_comp_16', 'pca_cluster_1_dist', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_62', 'CarMake_fracReturnedasm1DivTransactions', 'pca_comp_21', 'pca_comp_33', 'pca_comp_28', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_66', 'pca_comp_53', 'CarMake_fracDSEligible1DivTransactions', 'Mileage', 'pca_comp_05', 'pca_comp_04', 'pca_comp_71', 'CarMake_numTransactions', 'BuyerID_numTransactions', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_59', 'SellingLocation_lat', 'pca_comp_43', 'pca_comp_08', 'pca_comp_44', 'pca_comp_24', 'pca_comp_52', 'SaleDate_decyear', 'pca_comp_69', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_60', 'SellerID_fracReturnedasm1DivTransactions', 'SellerID_fracReturnedNotNullDivDSEligible1', 'SellingLocation_numTransactions', 'pca_comp_19', 'JDPowersCat_MIDSIZECAR', 'pca_comp_02', 'SalePrice', 'JDPowersCat_numTransactions', 'pca_comp_56', 'SellerID_numReturnedNotNull', 'ConditionReport', 'pca_comp_57', 'pca_comp_22', 'pca_comp_46', 'SellingLocation_fracReturnedasm1DivTransactions', 'Simulcast', 'pca_comp_29', 'pca_comp_18', 'Autocheck_score', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_12', 'cluster_1_dist', 'pca_comp_25', 'pca_comp_51', 'SellerID_numReturned1', 'BuyerID_numReturnedasm1']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6190.000000 6190.000000
mean 0.098613 0.107108
std 0.292975 0.315483
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturnedasm1 pca_comp_64
count 6190.000000 6190.000000 6.190000e+03
mean 0.008078 0.103069 4.269339e-18
std 0.087695 0.311425 3.184858e-02
min 0.000000 0.000000 -5.841709e-01
25% 0.000000 0.000000 -4.342334e-03
50% 0.000000 0.000000 -1.965280e-03
75% 0.000000 0.000000 1.178312e-03
max 1.000000 2.000000 3.681335e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.988
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.597
Chunk:
Evaluation time span: 2013-11-17 00:00:00 2013-11-23 00:00:00
Model return rate: 0.183979974969
Original return rate: 0.183979974969
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-11-23 00:00:00
Model return rate: 0.126773296245
Original return rate: 0.222263450835
########################################
Timestamp: 2017-03-02T10:11:15GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'pca_comp_68', 'pca_comp_71', 'pca_comp_66', 'InLane', 'DSEligible', 'pca_comp_65', 'VIN_fracReturned1DivReturnedNotNull', 'SellerID_fracDSEligible1DivTransactions', 'Arbitrated', 'pca_comp_51', 'pca_comp_61', 'cluster_0_dist', 'pca_comp_22', 'VIN_numDSEligible1', 'pca_comp_37', 'pca_cluster_0_dist', 'VIN_numReturned1', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'BuyerID_fracDSEligible1DivTransactions', 'BuyerID_numReturnedNotNull', 'VIN_numReturnedasm1', 'pca_comp_03', 'pca_comp_16', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_14', 'pca_comp_54', 'pca_comp_26', 'pca_comp_00', 'pca_comp_64', 'SellingLocation_fracReturned1DivReturnedNotNull', 'cluster_1_dist', 'pca_comp_40', 'pca_comp_50', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_43', 'pca_comp_74', 'pca_comp_25', 'JDPowersCat_numReturnedasm1', 'pca_cluster_1_dist', 'pca_comp_76', 'pca_comp_33', 'pca_comp_49', 'SellerID_numReturnedasm1', 'CarMake_numReturnedNotNull', 'pca_comp_11', 'SellingLocation_lat', 'pca_comp_32', 'pca_comp_07', 'pca_comp_69', 'pca_comp_27', 'Mileage', 'CarMake_numTransactions', 'pca_comp_62', 'pca_comp_23', 'SellingLocation_numReturned1', 'CarMake_fracReturnedNotNullDivDSEligible1', 'SellingLocation_numReturnedasm1', 'JDPowersCat_numDSEligible1', 'SellerID_numReturned1', 'pca_comp_01', 'pca_comp_44', 'pca_comp_48', 'CarMake_numReturned1', 'pca_comp_52', 'SellerID_fracReturned1DivReturnedNotNull', 'SellingLocation_numReturnedNotNull', 'SellerID_numTransactions', 'pca_comp_59', 'SellingLocation_numDSEligible1', 'pca_comp_67', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_73', 'PSI', 'pca_comp_60', 'pca_comp_06', 'BuyerID_numReturned1', 'pca_comp_15', 'BuyerID_numTransactions']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6301.000000 6301.000000
mean 0.128868 0.137915
std 0.330203 0.351674
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
Returned_asm pca_comp_68 pca_comp_71
count 6301.000000 6.301000e+03 6.301000e+03
mean 0.081416 -1.407876e-17 -1.256098e-17
std 0.273494 1.787217e-02 1.229425e-02
min 0.000000 -3.729362e-01 -1.994148e-01
25% 0.000000 -1.428422e-03 -1.757616e-03
50% 0.000000 2.584383e-04 -1.246202e-04
75% 0.000000 1.824388e-03 1.313047e-03
max 1.000000 3.348512e-01 1.809703e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.990
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.970
Chunk:
Evaluation time span: 2013-11-24 00:00:00 2013-11-30 00:00:00
Model return rate: 0.0
Original return rate: 0.181818181818
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-11-30 00:00:00
Model return rate: 0.123988301707
Original return rate: 0.221296631655
########################################
Timestamp: 2017-03-02T10:11:26GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_63', 'VIN_numReturnedasm1', 'pca_comp_56', 'VIN_numReturned1', 'BuyerID_fracReturned1DivReturnedNotNull', 'Returned_asm', 'DSEligible', 'pca_comp_61', 'pca_comp_54', 'pca_comp_68', 'Autocheck_score', 'pca_comp_40', 'pca_comp_53', 'SalePrice', 'pca_comp_19', 'pca_comp_58', 'pca_comp_04', 'pca_comp_14', 'pca_comp_55', 'SellerID_numReturned1', 'pca_comp_02', 'pca_comp_72', 'pca_comp_75', 'SellerID_numTransactions', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_35', 'CarMake_numReturnedNotNull', 'pca_comp_25', 'pca_comp_60', 'CarMake_numTransactions', 'pca_comp_22', 'pca_comp_71', 'SellerID_numDSEligible1', 'VIN_numDSEligible1', 'Mileage', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'BuyerID_fracReturnedasm1DivTransactions', 'pca_comp_62', 'CarYear', 'pca_comp_08', 'pca_comp_26', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_28', 'pca_comp_41', 'SellingLocation_fracDSEligible1DivTransactions', 'SellerID_numReturnedasm1', 'pca_comp_31', 'pca_comp_11', 'pca_comp_64', 'VIN_numTransactions', 'SellerID_numReturnedNotNull', 'pca_comp_27', 'pca_comp_23', 'pca_comp_24', 'pca_comp_10', 'pca_comp_07', 'CarMake_numDSEligible1', 'pca_comp_29', 'JDPowersCat_SUV', 'pca_comp_59', 'SellingLocation_lon', 'pca_comp_49', 'pca_comp_69', 'pca_comp_52']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 3574.000000 3574.000000
mean 0.089955 0.098769
std 0.279902 0.302122
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull \
count 3574.000000
mean 0.006156
std 0.077327
min 0.000000
25% 0.000000
50% 0.000000
75% 0.000000
max 1.000000
VIN_fracReturnedasm1DivTransactions pca_comp_63
count 3574.000000 3.574000e+03
mean 0.093593 1.419292e-17
std 0.284634 3.166459e-02
min 0.000000 -5.151490e-01
25% 0.000000 -5.959335e-03
50% 0.000000 -2.113078e-03
75% 0.000000 3.029562e-03
max 1.000000 1.830524e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.998
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.528
Chunk:
Evaluation time span: 2013-12-01 00:00:00 2013-12-07 00:00:00
Model return rate: 0.175675675676
Original return rate: 0.175675675676
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-12-07 00:00:00
Model return rate: 0.126465065078
Original return rate: 0.219345891598
########################################
Timestamp: 2017-03-02T10:11:36GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_64', 'pca_comp_52', 'pca_comp_65', 'pca_comp_69', 'VIN_numReturned1', 'BuyerID_fracReturned1DivReturnedNotNull', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_70', 'pca_comp_60', 'pca_comp_28', 'pca_comp_58', 'pca_comp_23', 'pca_comp_44', 'pca_comp_08', 'PSI', 'pca_comp_30', 'pca_comp_02', 'DSEligible', 'SellerID_numReturned1', 'SellerID_numReturnedasm1', 'pca_comp_09', 'pca_comp_38', 'PSIEligible', 'pca_comp_07', 'VIN_fracReturnedasm1DivTransactions', 'cluster_1_dist', 'InLane', 'pca_comp_18', 'pca_comp_27', 'CarMake_numDSEligible1', 'SellerID_numReturnedNotNull', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_66', 'VIN_numReturnedasm1', 'BuyerID_numTransactions', 'VIN_numDSEligible1', 'CarMake_numReturnedasm1', 'pca_comp_00', 'pca_comp_33', 'CarMake_numReturnedNotNull', 'pca_comp_11', 'pca_comp_42', 'VIN_numTransactions', 'CarMake_numReturned1', 'pca_comp_34', 'pca_comp_12', 'pca_comp_06', 'pca_comp_05', 'pca_comp_41', 'pca_comp_21', 'pca_comp_57', 'pca_comp_63', 'ConditionReport', 'pca_comp_37', 'pca_comp_15', 'Autocheck_score', 'pca_comp_76', 'SellerID_numTransactions', 'pca_comp_46', 'pca_comp_10', 'pca_comp_01', 'pca_comp_14', 'pca_comp_62', 'pca_comp_48', 'pca_comp_75', 'pca_cluster_1_dist', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_55', 'pca_comp_50', 'CarMake_numTransactions', 'BuyerID_numReturnedNotNull', 'pca_comp_19', 'pca_comp_61', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_03', 'pca_comp_54', 'pca_comp_35', 'pca_comp_51', 'SellingLocation_fracReturnedasm1DivTransactions', 'SellingLocation_fracReturned1DivReturnedNotNull', 'BuyerID_numReturned1', 'SalePrice', 'BuyerID_fracDSEligible1DivTransactions', 'CarMake_fracDSEligible1DivTransactions', 'pca_comp_67']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6150.000000 6150.000000
mean 0.119444 0.127154
std 0.319437 0.337055
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 3.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_64
count 6150.000000 6150.000000 6.150000e+03
mean 0.071057 0.025637 -2.857075e-18
std 0.256941 0.157432 2.726085e-02
min 0.000000 0.000000 -2.677673e-01
25% 0.000000 0.000000 -3.248264e-03
50% 0.000000 0.000000 1.086404e-03
75% 0.000000 0.000000 4.289136e-03
max 1.000000 1.000000 6.152466e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.996
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.972
Chunk:
Evaluation time span: 2013-12-09 00:00:00 2013-12-14 00:00:00
Model return rate: 0.0
Original return rate: 0.170186335404
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-12-14 00:00:00
Model return rate: 0.121221525666
Original return rate: 0.217160841478
########################################
Timestamp: 2017-03-02T10:11:46GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'VIN_fracReturned1DivReturnedNotNull', 'VIN_numReturned1', 'Returned_asm', 'VIN_numTransactions', 'DSEligible', 'pca_comp_63', 'pca_comp_61', 'SellerID_fracDSEligible1DivTransactions', 'pca_comp_67', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_01', 'pca_comp_69', 'pca_comp_21', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_54', 'SellerID_fracReturnedasm1DivTransactions', 'pca_comp_14', 'BuyerID_numReturned1', 'VIN_numReturnedasm1', 'JDPowersCat_PICKUP', 'SellerID_numTransactions', 'SellerID_numDSEligible1', 'Simulcast', 'pca_comp_41', 'pca_comp_42', 'pca_comp_66', 'cluster_1_dist', 'pca_comp_18', 'InLane', 'pca_comp_04', 'pca_comp_00', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_12', 'BuyerID_numReturnedNotNull', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_38', 'pca_comp_39', 'pca_comp_57', 'SellerID_numReturned1', 'pca_comp_09', 'VIN_numDSEligible1', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_64', 'pca_comp_17', 'pca_comp_33', 'pca_comp_20', 'pca_comp_16', 'pca_comp_73']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6193.000000 6193.000000
mean 0.111427 0.118682
std 0.310385 0.328396
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 2.000000
VIN_fracReturned1DivReturnedNotNull VIN_numReturned1 Returned_asm
count 6193.000000 6193.000000 6193.000000
mean 0.007186 0.007751 0.078960
std 0.082779 0.087703 0.269698
min 0.000000 0.000000 0.000000
25% 0.000000 0.000000 0.000000
50% 0.000000 0.000000 0.000000
75% 0.000000 0.000000 0.000000
max 1.000000 1.000000 1.000000
Progress: 20% 40% 60% 80% 100%
Model score = 0.990
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.650
Chunk:
Evaluation time span: 2013-12-15 00:00:00 2013-12-20 00:00:00
Model return rate: 0.144144144144
Original return rate: 0.144144144144
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-12-20 00:00:00
Model return rate: 0.122699030254
Original return rate: 0.212944175641
########################################
Timestamp: 2017-03-02T10:11:57GMT
`columns.pkl`, `transformer_scaler.pkl`, `transformer_pca.pkl`: Save column order and transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Save transformers.
`important_features` =
['VIN_fracReturnedNotNullDivDSEligible1', 'VIN_numReturnedNotNull', 'Returned_asm', 'VIN_fracReturned1DivReturnedNotNull', 'pca_comp_71', 'pca_comp_64', 'pca_comp_65', 'pca_comp_67', 'DSEligible', 'VIN_numReturned1', 'BuyerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_07', 'pca_comp_43', 'BuyerID_numReturnedasm1', 'BuyerID_fracDSEligible1DivTransactions', 'Mileage', 'Simulcast', 'VIN_numDSEligible1', 'SellingLocation_lon', 'VIN_fracReturnedasm1DivTransactions', 'pca_comp_37', 'pca_comp_52', 'pca_comp_13', 'pca_comp_10', 'pca_comp_25', 'pca_comp_48', 'pca_comp_02', 'BuyerID_fracReturnedasm1DivTransactions', 'CarYear', 'pca_comp_44', 'SellerID_fracReturnedNotNullDivDSEligible1', 'pca_comp_51', 'pca_comp_50', 'pca_comp_28', 'BuyerID_numTransactions', 'BuyerID_numDSEligible1', 'pca_comp_49', 'pca_comp_60', 'PSI', 'BuyerID_fracReturned1DivReturnedNotNull', 'pca_comp_36', 'pca_comp_47', 'pca_comp_05', 'pca_comp_53', 'JDPowersCat_fracReturnedNotNullDivDSEligible1', 'pca_comp_56', 'pca_comp_57', 'pca_comp_03', 'pca_comp_09', 'pca_comp_42', 'pca_comp_26', 'pca_comp_00', 'pca_comp_27', 'InLane', 'pca_comp_17', 'pca_comp_68', 'SellingLocation_numTransactions', 'pca_comp_34', 'pca_comp_38', 'CarMake_numReturnedasm1', 'pca_comp_40', 'pca_comp_30', 'LIGHTY', 'SellerID_fracReturnedasm1DivTransactions', 'SellingLocation_numDSEligible1', 'SellerID_fracReturned1DivReturnedNotNull', 'pca_comp_59', 'VIN_numTransactions', 'pca_comp_29', 'pca_comp_61', 'pca_comp_74', 'pca_comp_76', 'pca_comp_18', 'pca_comp_62', 'JDPowersCat_fracReturned1DivReturnedNotNull', 'CarMake_numReturnedNotNull', 'CarMake_fracReturnedasm1DivTransactions', 'BuyerID_numReturnedNotNull', 'BuyerID_numReturned1', 'MMR', 'pca_comp_16', 'JDPowersCat_COMPACTCAR', 'pca_comp_77', 'SellingLocation_numReturned1', 'CarMake_numDSEligible1', 'SellingLocation_numReturnedasm1', 'pca_comp_23', 'CarMake_numTransactions', 'pca_comp_12', 'pca_comp_35', 'SaleDate_dow', 'pca_comp_46', 'CarMake_numReturned1', 'pca_comp_33', 'SellingLocation_lat', 'SellerID_numTransactions', 'LIGHTR', 'Salvage', 'pca_comp_58', 'SellerID_numReturned1', 'pca_comp_45', 'pca_comp_32', 'SellingLocation_fracReturnedNotNullDivDSEligible1', 'pca_comp_22', 'pca_comp_41', 'CarMake_fracReturned1DivReturnedNotNull', 'pca_comp_55', 'pca_comp_08', 'pca_comp_14', 'SellingLocation_fracReturned1DivReturnedNotNull', 'JDPowersCat_fracReturnedasm1DivTransactions', 'SellingLocation_numReturnedNotNull', 'SellingLocation_fracDSEligible1DivTransactions', 'pca_comp_20', 'pca_comp_63', 'pca_comp_75', 'JDPowersCat_numReturned1', 'pca_comp_73', 'SalePrice', 'pca_comp_54', 'VIN_fracDSEligible1DivTransactions', 'pca_comp_01', 'pca_cluster']
Summarize top 5 important features:
VIN_fracReturnedNotNullDivDSEligible1 VIN_numReturnedNotNull \
count 6082.000000 6082.000000
mean 0.181538 0.191878
std 0.380963 0.402483
min 0.000000 0.000000
25% 0.000000 0.000000
50% 0.000000 0.000000
75% 0.000000 0.000000
max 1.000000 3.000000
Returned_asm VIN_fracReturned1DivReturnedNotNull pca_comp_71
count 6082.000000 6082.000000 6.082000e+03
mean 0.084512 0.031020 1.316872e-17
std 0.278177 0.172569 1.295064e-02
min 0.000000 0.000000 -1.915956e-01
25% 0.000000 0.000000 -1.696117e-03
50% 0.000000 0.000000 -1.835708e-04
75% 0.000000 0.000000 1.324500e-03
max 1.000000 1.000000 2.197499e-01
Progress: 20% 40% 60% 80% 100%
Model score = 0.987
`features.pkl`, `estimator.pkl`: Save features and estimator.
`transformer_scaler`, `transformer_pca`: Load existing transformers.
`transformer_kmeans.pkl`, `transformer_kmeans_pca.pkl`: Load transformers.
`features.pkl`, `estimator.pkl`: Save features and estimator.
Model score = 0.962
Chunk:
Evaluation time span: 2013-12-22 00:00:00 2013-12-28 00:00:00
Model return rate: 0.0
Original return rate: 0.142857142857
Overall:
Evaluation time span: 2013-02-03 00:00:00 2013-12-28 00:00:00
Model return rate: 0.12117910191
Original return rate: 0.212037179685